00:24 |
billymg |
whaack: yeah, i guess i was planning on having a local and remote copy anyway, will try to get it going tomorrow |
| |
~ 30 minutes ~ |
00:54 |
whaack |
billymg: cool, let me know if you run into any problems starting the "scan" function. |
01:01 |
billymg |
for sure, will do |
| |
~ 21 minutes ~ |
01:23 |
asciilifeform |
billymg: box is ready apart from ssds, have 2 and 2 to arrive fri. |
01:23 |
asciilifeform |
billymg: lemme know if need raid5 or 10 |
01:25 |
* |
asciilifeform also, in turn, endlessly frustrated by vendors, who these days 'oh? that, 6w ago? we're out' 'why didntcha tell me' '...' |
01:26 |
* |
asciilifeform at least, unlike these, doesn't charge folx for goodies which are awol |
01:27 |
* |
asciilifeform working on replenishing a proper stock of dulaps, so ~next~ fella doesn't have to sit and grrr |
01:27 |
asciilifeform |
after billymg's tho, will have to level up the rack to the premium size w/ 20A mains |
| |
~ 24 minutes ~ |
01:52 |
billymg |
asciilifeform: i'll go with raid 5 |
01:52 |
asciilifeform |
billymg: got it |
01:54 |
billymg |
am i right to conclude that in a 4 disk arrangement raid 10 provides 50% better failure protection than raid 5? |
01:54 |
asciilifeform |
similar (tolerates 1 disk fail) |
01:54 |
billymg |
ah, not 2? |
01:54 |
asciilifeform |
2 but only if from separate pairs |
01:55 |
asciilifeform |
raid10 gives you 'a1' 'b1' 'a2' 'b2', can tolerate e.g. a1 and a2 death but not e.g. a1 and b1 |
01:55 |
billymg |
that's why i was thinking 50% better than raid 5, where you get 50% shot of surviving a two disk failure |
01:56 |
asciilifeform |
in that respect better (and slightly faster), costs some storage tho (you get 50% of nominal disk blox, rather than 75% as in raid5) |
01:57 |
billymg |
yep, was weighing that as well |
01:57 |
* |
whaack realizes he needs to get RAID setup going as well. |
01:58 |
* |
asciilifeform operates all fullsized boxen (i.e. not lappies or 'toasters') in iron raid |
02:04 |
mats |
https://github.com/seemoo-lab/openhaystack |
02:06 |
asciilifeform |
mats: hm bypasses subscription ? |
02:06 |
asciilifeform |
(iirc normally crapple's location thing only worx w/ their irons) |
| |
~ 20 minutes ~ |
02:26 |
vex |
[http://logs.nosuchlabs.com/log/asciilifeform/2022-02-12#1078992] something to do with atmospheric NaCl baking on; hygroscopic, caustic, loop doesn't stop |
02:26 |
dulapbot |
Logged on 2022-02-12 11:10:43 asciilifeform: whaack: wonder what precisely kills'em. ( do you have a hygrometer in yer pad ? ) |
02:29 |
mats |
asciilifeform: yes looks like it |
02:30 |
mats |
you need an apple account though |
02:41 |
vex |
dunno how they zap themselves, seem to do it before it's visually obvious |
02:43 |
* |
crtdaydreams just today installed new 970 Evo Plus |
02:44 |
crtdaydreams |
Still gotta work out a partition structure. |
02:45 |
crtdaydreams |
download moar ram |
02:52 |
* |
vex wonders if subscribers can pay to have dedicated spares ready to go? |
| |
~ 20 minutes ~ |
03:13 |
vex |
raid works best when you're nopt waiting on korea for moons |
03:15 |
vex |
alf is obviously running a business, but if he could wharehouse some small boxen, brothers could help each other |
| |
~ 34 minutes ~ |
03:49 |
vex |
as was the case with Piz |
| |
~ 56 minutes ~ |
04:46 |
vex |
did you get barreled whaak? ever run a hand plane? |
04:47 |
vex |
redefine the foam in your face |
04:50 |
whaack |
vex: i have a hand plane and flippers, but i don't like using them |
04:50 |
vex |
ever gone nudie? |
04:50 |
whaack |
probably just because i am inexperienced, but when i bodysurf i like the feeling of being ~naked |
04:50 |
vex |
it's a thing |
| |
~ 17 minutes ~ |
05:08 |
whaack |
nah, haven't done bodysurfing/surfing nude |
05:09 |
whaack |
and i went to the shorebreak and just let the barrels break over me, so i got a lot of great views, but not barreled + escaped |
05:09 |
vex |
who's going to complain? |
05:10 |
vex |
I've swum in huge |
05:11 |
vex |
chest just barely glancing actoss the rocks |
05:11 |
whaack |
vex: do you surf much? |
05:12 |
whaack |
not so many people know about the hand plane unless they're into the psort, afaik |
05:12 |
vex |
nah Imma kook. |
05:14 |
vex |
i like a quiet spot |
| |
~ 21 minutes ~ |
05:35 |
vex |
https://www.youtube.com/watch?v=ZVmZ-gKgQJE |
05:37 |
vex |
check the dolphin |
| |
~ 19 minutes ~ |
05:57 |
scoopbot |
New article on A Syndication of Verisimilitudes: Art of Latin Noun Declensions |
| |
~ 15 minutes ~ |
06:12 |
vex |
dfaq |
06:13 |
vex |
https://www.youtube.com/watch?v=tHV7AwkzYWg |
06:15 |
verisimilitude |
http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078919 I've not posted on 4chan's /g/ in over half a decade, and I'd rather maintain my streak. |
06:15 |
dulapbot |
Logged on 2022-02-11 23:13:05 shinohai: http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078907 <<< Just post it to /g/ kek |
06:16 |
verisimilitude |
Besides, it was a hellhole back then, and even worse now. |
06:16 |
vex |
what's g? |
06:17 |
verisimilitude |
https://boards.4channel.org/g/ |
06:17 |
verisimilitude |
http://logs.nosuchlabs.com/log/asciilifeform/2022-02-12#1078983 I'm referring to my language speaking and thinking skills. |
06:17 |
dulapbot |
Logged on 2022-02-12 08:25:51 adlai: http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078848 << are you referring to Elision, and related ideas? |
06:18 |
vex |
8chan had afailover aftter mp bought adpace |
06:19 |
verisimilitude |
I've ``cold emailed'' others, crtdaydreams, but it rarely amounts to anything. |
06:20 |
vex |
https://www.youtube.com/watch?v=LZ5fIKmn1ok |
06:23 |
vex |
hotwheels told me I was the weirdest thing he's ver seen |
06:23 |
vex |
you're a head in a wheelchair |
| |
↖ |
06:23 |
verisimilitude |
Yes. |
06:24 |
vex |
anyway 8 can beacame something elks |
06:25 |
verisimilitude |
It's dead. |
06:25 |
vex |
lister sisterchans wnet squirelling for winter |
06:26 |
vex |
2chan is the original? |
06:29 |
vex |
so nippon |
06:29 |
verisimilitude |
Sure. |
06:32 |
vex |
im the reason moot hates aussies |
06:34 |
verisimilitude |
Stop asking stupid questions, vex. |
06:34 |
vex |
how old are you verisimilitude? |
06:35 |
verisimilitude |
That's private. |
06:37 |
vex |
you're lucky. my older pets will hold u down |
06:38 |
vex |
I don't expext ny complaints |
06:39 |
verisimilitude |
Okay. |
06:39 |
vex |
not happening. |
06:41 |
vex |
they say it is |
06:41 |
vex |
you're gonna be outta sight for a little while. hold the fuck on |
06:42 |
verisimilitude |
I suppose vex is like a father figure to me, owing to the nightly inebriation. |
06:43 |
vex |
nah. just a bullshit artist |
06:43 |
verisimilitude |
Oh, I'd misread ``im the reason moot hates aussies'' as a question. |
06:43 |
verisimilitude |
Comment on my latest art, vex. |
06:44 |
vex |
I did look. can't rememeber |
06:44 |
verisimilitude |
Look again; there's no cost. |
06:44 |
* |
vex scrolls up |
06:47 |
vex |
i learded some latin in channel th other day |
06:48 |
verisimilitude |
Tell me more. |
06:49 |
vex |
ammend mistakes |
06:50 |
verisimilitude |
Yes, I was there. |
06:50 |
vex |
New to me |
06:50 |
vex |
I only use english |
06:51 |
verisimilitude |
Yes, how nice it is to learn. |
06:52 |
vex |
I appreciate the insights |
06:59 |
vex |
https://www.youtube.com/watch?v=WaFxaAcbr1c |
07:07 |
vex |
https://www.youtube.com/watch?v=d73tiBBzvFM |
07:10 |
vex |
https://www.youtube.com/watch?v=iG590ZZMqJk |
07:13 |
vex |
seen BingoBoingo ? |
| |
~ 7 hours 31 minutes ~ |
14:44 |
whaack |
morning all |
14:45 |
whaack |
!e view-height |
14:45 |
trbexplorer |
block_height: 723282 |
14:45 |
trbexplorer |
mins_since_last_block: 10 |
| |
~ 30 minutes ~ |
15:15 |
asciilifeform |
$ticker btc usd |
15:15 |
busybot |
Current BTC price in USD: $42603.28 |
15:15 |
asciilifeform |
!w poll |
15:15 |
watchglass |
Polling 14 nodes... |
15:15 |
watchglass |
205.134.172.4:8333 : (172-4.core.ai.net) Alive: (0.021s) V=70001 (/therealbitcoin.org:0.7.0.1/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
205.134.172.6:8333 : (172-6.core.ai.net) Alive: (0.091s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Return Addr=0.0.0.0:8333 Blocks=723287 |
15:15 |
watchglass |
205.134.172.27:8333 : Alive: (0.094s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 (Operator: asciilifeform) |
15:15 |
watchglass |
54.39.156.171:8333 : (ns562940.ip-54-39-156.net) Alive: (0.172s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
71.191.220.241:8333 : (pool-71-191-220-241.washdc.fios.verizon.net) Alive: (0.154s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 (Operator: asciilifeform) |
15:15 |
watchglass |
205.134.172.28:8333 : Alive: (0.144s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Return Addr=0.0.0.0:8333 Blocks=723287 (Operator: whaack) |
15:15 |
watchglass |
208.94.240.42:8333 : Alive: (0.203s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
54.38.94.63:8333 : (ns3140226.ip-54-38-94.eu) Alive: (0.258s) V=88888 (/therealbitcoin.org:0.8.88.88/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
82.79.58.192:8333 : (static-82-79-58-192.rdsnet.ro) Alive: (0.328s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
103.36.92.112:8333 : (terebe.ns01.net) Alive: (0.524s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:15 |
watchglass |
75.106.222.93:8333 : Alive: (0.408s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 |
15:16 |
watchglass |
94.176.238.102:8333 : Violated BTC Protocol: Bad header length! |
15:17 |
watchglass |
205.134.172.26:8333 : Busy? (No answer in 100 sec.) |
15:17 |
watchglass |
143.202.160.10:8333 : Busy? (No answer in 100 sec.) |
| |
~ 1 hours 20 minutes ~ |
16:37 |
billymg |
whaack: sitting down with your explorer now, is sqlite3 version > 3.7 a hard requirement? i have 3.35 installed currently |
16:39 |
whaack |
billymg: that may work |
16:40 |
whaack |
billymg: But I recall I ran into some issue with the sql version... digging through logs to see what it was |
16:40 |
whaack |
and ty for doing this right after I published, I appreciate it |
16:40 |
billymg |
ok i'll try it out then before upgrading, will let you know if i run into any issues with the 3.35 version |
16:43 |
whaack |
billymg: okay, and if you at some point decide to run the webserver on a gentoo box this will be handy http://ztkfg.com/2021/07/a-short-guide-for-setting-up-apache-with-flask-on-gentoo/ |
16:48 |
billymg |
oh hey, i must have missed that guide, good to know it's there |
16:49 |
billymg |
the logotron and crawler both run on flask atop apache so unfortunately i'm already familiar with it |
16:50 |
whaack |
billymg: i had also forgot that i wrote that guide myself until recently lol |
16:53 |
whaack |
billymg: http://logs.nosuchlabs.com/log/ossasepia/2020-07-11#1027742 some comments re the sqlite3 version, supported version is 3.7.12. But 3.35 looks like it is a way higher version |
16:53 |
dulapbot |
(ossasepia) 2020-07-11 jfw: whaack: found the fix in http://archive.is/dDtit which looks to have quietly slipped into 3.7.12. Previously my documented minimum requirement was 3.7.0, which I now see the centos6 rpm doesn't meet. Expect transactional throughput to very much suck due to lack of WAL journal mode (or sacrifice crash consistency). |
16:54 |
whaack |
the decimal versioning system is quite silly, 3.35 > 3.7 |
17:05 |
billymg |
whaack: ah, lol |
17:05 |
billymg |
that's right, many softs do this |
17:07 |
whaack |
yeah it trips me up every time |
17:16 |
billymg |
whaack: in this step: `sqlite3 ~/.gbw/db </package/gbw-node/library/schema-node.sql`, is '/package/gbw-node/library/schema-node.sql' something i'd have if i had GBW installed already? |
17:18 |
whaack |
billymg: Ah, that is an error in the readme |
17:18 |
whaack |
it's in library/schema-node.sql |
17:18 |
whaack |
that's a legacy line from the original README |
17:18 |
billymg |
got it |
17:20 |
whaack |
and i kept the directory name "~/.gbw" mostly because i didn't want to alter my directory names on my machines, but it is a legacy of the code being originally for Gales Bitcoin Wallet |
17:29 |
whaack |
billymg: Did you get the scanning to begin ? |
17:37 |
billymg |
whaack: went and made myself some coffee first actually :D, but just tried now and got this error: http://paste.deedbot.org/?id=obxU |
17:41 |
billymg |
modified those two lines (37,38) to point to the paths i have, got a bit further and then hit this: http://paste.deedbot.org/?id=wEtc |
17:41 |
whaack |
billymg: You need to set the environ variable GBW_HOME, for ex. in ~/bash_rc add the line "export GBW_HOME='/home/billymg'" and then run `source ~/.bash_rc` |
17:42 |
whaack |
billymg: ah that is a real bug, one second |
17:46 |
billymg |
this is my desktop and i threw an extra ssd in after the fact, so i have my trb blockchain in the default home location, on the first ssd, and initialized the explorer db on the second ssd |
17:46 |
whaack |
kk that shouldn't be a problem |
17:47 |
billymg |
but it means GBW_HOME prefix would have to be different for those two lines, no? |
17:47 |
billymg |
that's why i just hardcoded the paths for now |
17:47 |
billymg |
i could do a symlink thing too i guess |
17:47 |
whaack |
the second bug you're seeing is a simple edge case error caused because when we scan we check to make sure that prev_hash of the block were scanning matches the hash of the prior block |
17:48 |
billymg |
personally i'd like to have those as startup flags that you can pass to the proggy |
17:48 |
whaack |
but i didn't test this from block 0, and we're indexing into block - 1 |
17:48 |
billymg |
ah, classic lol |
17:49 |
whaack |
billymg: this should fix it http://paste.deedbot.org/?id=Chyw |
17:49 |
billymg |
whaack: that fixed it! |
17:49 |
whaack |
the if height == 0, return true are the two lines you need to add. I will post a vpatch , but maybe add those lines yourself and try again |
17:50 |
billymg |
seems to be scanning now |
17:50 |
whaack |
awesome! |
17:50 |
whaack |
you can try running python trbexplorer.py view-block 0 |
17:50 |
billymg |
what do you think about having the datadirs as flags? |
17:51 |
billymg |
one prefix assumes trb chain and explorer db are in the same parent directory |
17:51 |
whaack |
billymg: ah i see, yeah and this case of having them in different directories will be pretty common given the sizes of the dbs |
17:52 |
billymg |
that view-block command worked fine too, neat! |
17:52 |
whaack |
well i think environment variables are okay, i don't think it makes sense to pass them to the proggy everytime you run it, and you can always set environ variables in the same line that you start the program if you want to |
17:53 |
whaack |
but i agree there should be separate variables for the location of the .bitcoin directory and for the location of your trbexplorer db |
17:53 |
billymg |
yeah, no strong opinion on flag vs env variable |
17:54 |
whaack |
billymg: every 50 blocks or so there should be a print out of the prediction on how long the sync is going to take, how long does yours say? |
17:54 |
whaack |
(it's going to underestimate by a lot, but curious to see what it reads) |
17:55 |
billymg |
"Processing blocks for 3.34939098358 seconds at 14.928087 blocks_per_second per the last 50 blocks, there are 707849blocks remaining, estimated time to completion is 0.0 days, 13.0 hours, 10.0 minutes, and 17.2611667442 seconds." |
17:56 |
whaack |
ah, if only |
17:56 |
billymg |
ah, yeah, the estimate jumps around (i think i saw you talking about this in the logs) |
17:56 |
billymg |
saw one go by for 2 days and change, and the next a day and change |
17:57 |
billymg |
now 5 days... |
17:57 |
whaack |
well the scanning is much more steady than trb, but it starts to slow down as the index of txs and addresses gets large |
17:57 |
asciilifeform |
whaack: left comment on your www, seems to be in spam queue |
17:58 |
billymg |
whaack: pretty fuckin' cool though |
17:59 |
whaack |
asciilifeform: approved |
17:59 |
asciilifeform |
whaack: ty |
18:01 |
whaack |
billymg: Yup, the best part is you can go into the db via the sqlite3 command line tool and start running your own arbitrary queries |
18:01 |
billymg |
whaack: do you know if the scanning is CPU bound? i noticed you're using python's threading instead of multiprocessing, iirc the latter lets you use multiple OS threads |
18:02 |
billymg |
my crawler uses threading only because the only bottleneck there was network io (waiting for node responses), so a single python thread is more than enough |
18:02 |
whaack |
billymg: I do not know, to be honest, and the threading and setup of the sqlite3 db were written by jfw |
18:02 |
asciilifeform |
pretty simple algo, will restate ftr: add cmdline flag '-cement=path_to_cement_file'. file is a (signed by producer, verified by noad operator) list of blox #s and corresponding hashes |
18:02 |
dulapbot |
(therealbitcoin) 2020-08-30 asciilifeform: http://logs.nosuchlabs.com/log/therealbitcoin/2020-08-30#1001100 << imho 'cement' would be useful if implemented compactly; then could feed a node <100MB signed list of hashes and it'll download correct blox through N from the net. but indeed 'less mutilation is best' imho when comes to trb; and if thinking about it, ANY trb node that aint synced to ~current height, will in fact refuse to relay most tx (and |
18:04 |
asciilifeform |
when requesting next block, if current height < max_cement_height , then request specifically next hash from cement. |
18:04 |
whaack |
asciilifeform: there are two things going on here, trb's sync from the outer world, and trbexplorer's sync from the local trb |
18:04 |
billymg |
whaack: ah, perhaps worth taking a look at python's multiprocessing then. i've never used it myself but when i was looking at it seemed to have a very similar API to 'threading' |
18:04 |
asciilifeform |
whaack: speaking of trb sync per se |
18:07 |
whaack |
asciilifeform: maybe that's a project i'm willing to take on next |
18:08 |
asciilifeform |
whaack: imho is a++ project |
18:10 |
asciilifeform |
asciilifeform's cement maker. note, is buggy, i.e. needs whaack's 'dumpblock' patch to actually produce correct output, as it happens |
18:10 |
whaack |
billymg: You will also need the dumpblock patch for your trb or you will experience problems scanning |
18:15 |
whaack |
billymg: if you don't have the dumpblock patch then at some point you're going to request a block from trb and you're going to get back some orphan, and then the scanner is going to get stuck in a loop of adding the orphan and then deleting it back and fourth as it tries to reorg from a detected hash mismatch |
18:15 |
asciilifeform |
the hygienic way to use 'cement' of course would be, in order of preference, 1) cement from 1 of yer existing noades 2) cement from several of yer l1 folx who agree on 1..n (as they oughta) and all signed |
18:16 |
whaack |
asciilifeform: I can use my trbexplorer to sign a 2 column file of (block number, hashes) in the near future |
18:17 |
asciilifeform |
whaack: imho automated signers are a dodgy proposition and at any rate not really needed. |
18:18 |
asciilifeform |
if folx post up-to-date cement ~yearly, will more than suffice for quick (wks, rather than months) sync |
18:23 |
whaack |
asciilifeform: I wasn't implying that the signing would be automatic |
18:23 |
asciilifeform |
a |
18:23 |
asciilifeform |
certainly would be useful if it could return cement for 0..n, for specified n |
18:24 |
asciilifeform |
signing/verifying best left to operators' hands tho. |
18:25 |
asciilifeform |
worth noting that what the prb people do is already equivalent to a (braindamaged implementation of) 'cement', where they request headers 1st, but do so from arbitrary rando automatically, rather than from source specified by operator |
18:25 |
asciilifeform |
is the only reason prb 'syncs quickly' |
18:27 |
whaack |
right, but as much as we shit on prb, they actually find solutions to problems (even though they ignore principles) |
18:28 |
asciilifeform |
this was their 'solution' to 'sync faster!111' |
18:28 |
asciilifeform |
moar generally, their 'solution' largely consists of 'lusers dun bother to operate noad, keep coin in gox' etc |
18:30 |
whaack |
i'm not defending them as much as noting that we fail at producing basic stuff, and then constantly have to rely on their tools (like wallets and blockexplorers) |
18:32 |
whaack |
but looks like if you're right about how much of a speedup the cement code your mentioning will produce, then all the heavy lifting of finding a good solution is done, and the implementation should not be too much of a job |
18:32 |
asciilifeform |
whaack: can only speak for self, but asciilifeform not relying on prb wallets. as for block exploders, they are useful but imho a luxury, i.e. not actually necessary for handling own tx, but largely for 'voyeurism' of others |
18:38 |
* |
asciilifeform very much in favour of trb-powered exploder & whaack's experiment. but must point out the obv. fact that while seeing tx you didn't generate yerself is often interesting , you wouldn't want to rely on a 3rdparty exploder to see whether you've been paid |
18:41 |
whaack |
asciilifeform: that's the point of open sourcing it, so you can have your own local explorer, to facilitate any resarch you wanna do (via sql queries) and to allow yourself to look up any address without inadvertly doxxing yourself |
18:41 |
asciilifeform |
aha |
18:42 |
asciilifeform |
( see also re logical conclusion ) |
18:42 |
dulapbot |
Logged on 2022-01-30 14:23:19 asciilifeform: http://logs.nosuchlabs.com/log/asciilifeform/2022-01-30#1077257 << imho the correct place for a block exploder is ultimately a pseudoserver within trb noad per se, locally |
18:43 |
whaack |
the public facing apis are for outreach, or easy access when you wanna know something that is not privacy sensitive while away from terminal |
18:43 |
asciilifeform |
right |
18:44 |
asciilifeform |
imho trb oughta use a db that's accessible from other process on same box. would then be trivial to query arbitrary addr balances, dissect blox, etc |
18:45 |
whaack |
billymg: Btw, regarding multithreading, from my experience in my performance-optimization MIT course I took, multithreading is the last step, it adds massive headaches of complexity, and your maximum gain is capped by the number of cores you have. |
| |
↖ |
18:45 |
asciilifeform |
whaack: funnily enuff, trb in fact suffers from all of these headaches, w/out any of the win. but you already knew this. |
18:46 |
whaack |
heh, i know it from reading the logs, but i'm quite unfamiliar with the trb source itself |
18:47 |
asciilifeform |
whaack: there's a buncha threads, but also locks haphazardly littered around errywhere, so in effect only 1 is able to run at a given time |
18:53 |
billymg |
whaack: makes sense. like i said my crawler was network i/o bound when single-threaded, adding threading allowed it to send out pings and process results from 100s of nodes simultaneously (whatever you set the max_sockets knob to in the crawler's config) |
18:54 |
billymg |
i only suggested it because i noticed your code was already using threading (so it already has some of the multithreading complexity added/handled) |
18:54 |
billymg |
though admit did not read enough to see how you were using it |
18:55 |
billymg |
and also do not know how direct the translation is from the 'threading' library to the 'multiprocessing' library, probably not 4free in terms of complexity, but idk |
| |
~ 1 hours 39 minutes ~ |
20:34 |
scoopbot |
New article on whaack: Podcast Episode 02 - The USDdb and Bitcoin's Speculative Attack |
| |
~ 43 minutes ~ |
21:18 |
shinohai |
>tfw one of the girls announces above podcast to me, and pronounces whaack like it rhymes with "quake". xD |
21:21 |
whaack |
aha, technically it's pronounced walk, since my last name haack is pronounced like hawk, but i usually read it in my own head as whack |
| |
~ 17 minutes ~ |
21:39 |
whaack |
off for today, i wanted to make a note here that mpwp's comment form should state that a valid email is not required for commenting |