Show Idle (>14 d.) Chans


← 2022-02-13 | 2022-02-15 →
00:24 billymg whaack: yeah, i guess i was planning on having a local and remote copy anyway, will try to get it going tomorrow
~ 30 minutes ~
00:54 whaack billymg: cool, let me know if you run into any problems starting the "scan" function.
01:01 billymg for sure, will do
~ 21 minutes ~
01:23 asciilifeform billymg: box is ready apart from ssds, have 2 and 2 to arrive fri.
01:23 asciilifeform billymg: lemme know if need raid5 or 10
01:25 * asciilifeform also, in turn, endlessly frustrated by vendors, who these days 'oh? that, 6w ago? we're out' 'why didntcha tell me' '...'
01:26 * asciilifeform at least, unlike these, doesn't charge folx for goodies which are awol
01:27 * asciilifeform working on replenishing a proper stock of dulaps, so ~next~ fella doesn't have to sit and grrr
01:27 asciilifeform after billymg's tho, will have to level up the rack to the premium size w/ 20A mains
~ 24 minutes ~
01:52 billymg asciilifeform: i'll go with raid 5
01:52 asciilifeform billymg: got it
01:54 billymg am i right to conclude that in a 4 disk arrangement raid 10 provides 50% better failure protection than raid 5?
01:54 asciilifeform similar (tolerates 1 disk fail)
01:54 billymg ah, not 2?
01:54 asciilifeform 2 but only if from separate pairs
01:55 asciilifeform raid10 gives you 'a1' 'b1' 'a2' 'b2', can tolerate e.g. a1 and a2 death but not e.g. a1 and b1
01:55 billymg that's why i was thinking 50% better than raid 5, where you get 50% shot of surviving a two disk failure
01:56 asciilifeform in that respect better (and slightly faster), costs some storage tho (you get 50% of nominal disk blox, rather than 75% as in raid5)
01:57 billymg yep, was weighing that as well
01:57 * whaack realizes he needs to get RAID setup going as well.
01:58 * asciilifeform operates all fullsized boxen (i.e. not lappies or 'toasters') in iron raid
02:04 mats https://github.com/seemoo-lab/openhaystack
02:06 asciilifeform mats: hm bypasses subscription ?
02:06 asciilifeform (iirc normally crapple's location thing only worx w/ their irons)
~ 20 minutes ~
02:26 vex [http://logs.nosuchlabs.com/log/asciilifeform/2022-02-12#1078992] something to do with atmospheric NaCl baking on; hygroscopic, caustic, loop doesn't stop
02:26 dulapbot Logged on 2022-02-12 11:10:43 asciilifeform: whaack: wonder what precisely kills'em. ( do you have a hygrometer in yer pad ? )
02:29 mats asciilifeform: yes looks like it
02:30 mats you need an apple account though
02:41 vex dunno how they zap themselves, seem to do it before it's visually obvious
02:43 * crtdaydreams just today installed new 970 Evo Plus
02:44 crtdaydreams Still gotta work out a partition structure.
02:45 crtdaydreams download moar ram
02:52 * vex wonders if subscribers can pay to have dedicated spares ready to go?
~ 20 minutes ~
03:13 vex raid works best when you're nopt waiting on korea for moons
03:15 vex alf is obviously running a business, but if he could wharehouse some small boxen, brothers could help each other
~ 34 minutes ~
03:49 vex as was the case with Piz
~ 56 minutes ~
04:46 vex did you get barreled whaak? ever run a hand plane?
04:47 vex redefine the foam in your face
04:50 whaack vex: i have a hand plane and flippers, but i don't like using them
04:50 vex ever gone nudie?
04:50 whaack probably just because i am inexperienced, but when i bodysurf i like the feeling of being ~naked
04:50 vex it's a thing
~ 17 minutes ~
05:08 whaack nah, haven't done bodysurfing/surfing nude
05:09 whaack and i went to the shorebreak and just let the barrels break over me, so i got a lot of great views, but not barreled + escaped
05:09 vex who's going to complain?
05:10 vex I've swum in huge
05:11 vex chest just barely glancing actoss the rocks
05:11 whaack vex: do you surf much?
05:12 whaack not so many people know about the hand plane unless they're into the psort, afaik
05:12 vex nah Imma kook.
05:14 vex i like a quiet spot
~ 21 minutes ~
05:35 vex https://www.youtube.com/watch?v=ZVmZ-gKgQJE
05:37 vex check the dolphin
~ 19 minutes ~
05:57 scoopbot New article on A Syndication of Verisimilitudes: Art of Latin Noun Declensions
~ 15 minutes ~
06:12 vex dfaq
06:13 vex https://www.youtube.com/watch?v=tHV7AwkzYWg
06:15 verisimilitude http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078919 I've not posted on 4chan's /g/ in over half a decade, and I'd rather maintain my streak.
06:15 dulapbot Logged on 2022-02-11 23:13:05 shinohai: http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078907 <<< Just post it to /g/ kek
06:16 verisimilitude Besides, it was a hellhole back then, and even worse now.
06:16 vex what's g?
06:17 verisimilitude https://boards.4channel.org/g/
06:17 verisimilitude http://logs.nosuchlabs.com/log/asciilifeform/2022-02-12#1078983 I'm referring to my language speaking and thinking skills.
06:17 dulapbot Logged on 2022-02-12 08:25:51 adlai: http://logs.nosuchlabs.com/log/asciilifeform/2022-02-11#1078848 << are you referring to Elision, and related ideas?
06:18 vex 8chan had afailover aftter mp bought adpace
06:19 verisimilitude I've ``cold emailed'' others, crtdaydreams, but it rarely amounts to anything.
06:20 vex https://www.youtube.com/watch?v=LZ5fIKmn1ok
06:23 vex hotwheels told me I was the weirdest thing he's ver seen
06:23 vex you're a head in a wheelchair
06:23 verisimilitude Yes.
06:24 vex anyway 8 can beacame something elks
06:25 verisimilitude It's dead.
06:25 vex lister sisterchans wnet squirelling for winter
06:26 vex 2chan is the original?
06:29 vex so nippon
06:29 verisimilitude Sure.
06:32 vex im the reason moot hates aussies
06:34 verisimilitude Stop asking stupid questions, vex.
06:34 vex how old are you verisimilitude?
06:35 verisimilitude That's private.
06:37 vex you're lucky. my older pets will hold u down
06:38 vex I don't expext ny complaints
06:39 verisimilitude Okay.
06:39 vex not happening.
06:41 vex they say it is
06:41 vex you're gonna be outta sight for a little while. hold the fuck on
06:42 verisimilitude I suppose vex is like a father figure to me, owing to the nightly inebriation.
06:43 vex nah. just a bullshit artist
06:43 verisimilitude Oh, I'd misread ``im the reason moot hates aussies'' as a question.
06:43 verisimilitude Comment on my latest art, vex.
06:44 vex I did look. can't rememeber
06:44 verisimilitude Look again; there's no cost.
06:44 * vex scrolls up
06:47 vex i learded some latin in channel th other day
06:48 verisimilitude Tell me more.
06:49 vex ammend mistakes
06:50 verisimilitude Yes, I was there.
06:50 vex New to me
06:50 vex I only use english
06:51 verisimilitude Yes, how nice it is to learn.
06:52 vex I appreciate the insights
06:59 vex https://www.youtube.com/watch?v=WaFxaAcbr1c
07:07 vex https://www.youtube.com/watch?v=d73tiBBzvFM
07:10 vex https://www.youtube.com/watch?v=iG590ZZMqJk
07:13 vex seen BingoBoingo ?
~ 7 hours 31 minutes ~
14:44 whaack morning all
14:45 whaack !e view-height
14:45 trbexplorer block_height: 723282
14:45 trbexplorer mins_since_last_block: 10
~ 30 minutes ~
15:15 asciilifeform $ticker btc usd
15:15 busybot Current BTC price in USD: $42603.28
15:15 asciilifeform !w poll
15:15 watchglass Polling 14 nodes...
15:15 watchglass 205.134.172.4:8333 : (172-4.core.ai.net) Alive: (0.021s) V=70001 (/therealbitcoin.org:0.7.0.1/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 205.134.172.6:8333 : (172-6.core.ai.net) Alive: (0.091s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Return Addr=0.0.0.0:8333 Blocks=723287
15:15 watchglass 205.134.172.27:8333 : Alive: (0.094s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 (Operator: asciilifeform)
15:15 watchglass 54.39.156.171:8333 : (ns562940.ip-54-39-156.net) Alive: (0.172s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 71.191.220.241:8333 : (pool-71-191-220-241.washdc.fios.verizon.net) Alive: (0.154s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287 (Operator: asciilifeform)
15:15 watchglass 205.134.172.28:8333 : Alive: (0.144s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Return Addr=0.0.0.0:8333 Blocks=723287 (Operator: whaack)
15:15 watchglass 208.94.240.42:8333 : Alive: (0.203s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 54.38.94.63:8333 : (ns3140226.ip-54-38-94.eu) Alive: (0.258s) V=88888 (/therealbitcoin.org:0.8.88.88/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 82.79.58.192:8333 : (static-82-79-58-192.rdsnet.ro) Alive: (0.328s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 103.36.92.112:8333 : (terebe.ns01.net) Alive: (0.524s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:15 watchglass 75.106.222.93:8333 : Alive: (0.408s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=723287
15:16 watchglass 94.176.238.102:8333 : Violated BTC Protocol: Bad header length!
15:17 watchglass 205.134.172.26:8333 : Busy? (No answer in 100 sec.)
15:17 watchglass 143.202.160.10:8333 : Busy? (No answer in 100 sec.)
~ 1 hours 20 minutes ~
16:37 billymg whaack: sitting down with your explorer now, is sqlite3 version > 3.7 a hard requirement? i have 3.35 installed currently
16:39 whaack billymg: that may work
16:40 whaack billymg: But I recall I ran into some issue with the sql version... digging through logs to see what it was
16:40 whaack and ty for doing this right after I published, I appreciate it
16:40 billymg ok i'll try it out then before upgrading, will let you know if i run into any issues with the 3.35 version
16:43 whaack billymg: okay, and if you at some point decide to run the webserver on a gentoo box this will be handy http://ztkfg.com/2021/07/a-short-guide-for-setting-up-apache-with-flask-on-gentoo/
16:48 billymg oh hey, i must have missed that guide, good to know it's there
16:49 billymg the logotron and crawler both run on flask atop apache so unfortunately i'm already familiar with it
16:50 whaack billymg: i had also forgot that i wrote that guide myself until recently lol
16:53 whaack billymg: http://logs.nosuchlabs.com/log/ossasepia/2020-07-11#1027742 some comments re the sqlite3 version, supported version is 3.7.12. But 3.35 looks like it is a way higher version
16:53 dulapbot (ossasepia) 2020-07-11 jfw: whaack: found the fix in http://archive.is/dDtit which looks to have quietly slipped into 3.7.12. Previously my documented minimum requirement was 3.7.0, which I now see the centos6 rpm doesn't meet. Expect transactional throughput to very much suck due to lack of WAL journal mode (or sacrifice crash consistency).
16:54 whaack the decimal versioning system is quite silly, 3.35 > 3.7
17:05 billymg whaack: ah, lol
17:05 billymg that's right, many softs do this
17:07 whaack yeah it trips me up every time
17:16 billymg whaack: in this step: `sqlite3 ~/.gbw/db </package/gbw-node/library/schema-node.sql`, is '/package/gbw-node/library/schema-node.sql' something i'd have if i had GBW installed already?
17:18 whaack billymg: Ah, that is an error in the readme
17:18 whaack it's in library/schema-node.sql
17:18 whaack that's a legacy line from the original README
17:18 billymg got it
17:20 whaack and i kept the directory name "~/.gbw" mostly because i didn't want to alter my directory names on my machines, but it is a legacy of the code being originally for Gales Bitcoin Wallet
17:29 whaack billymg: Did you get the scanning to begin ?
17:37 billymg whaack: went and made myself some coffee first actually :D, but just tried now and got this error: http://paste.deedbot.org/?id=obxU
17:41 billymg modified those two lines (37,38) to point to the paths i have, got a bit further and then hit this: http://paste.deedbot.org/?id=wEtc
17:41 whaack billymg: You need to set the environ variable GBW_HOME, for ex. in ~/bash_rc add the line "export GBW_HOME='/home/billymg'" and then run `source ~/.bash_rc`
17:42 whaack billymg: ah that is a real bug, one second
17:46 billymg this is my desktop and i threw an extra ssd in after the fact, so i have my trb blockchain in the default home location, on the first ssd, and initialized the explorer db on the second ssd
17:46 whaack kk that shouldn't be a problem
17:47 billymg but it means GBW_HOME prefix would have to be different for those two lines, no?
17:47 billymg that's why i just hardcoded the paths for now
17:47 billymg i could do a symlink thing too i guess
17:47 whaack the second bug you're seeing is a simple edge case error caused because when we scan we check to make sure that prev_hash of the block were scanning matches the hash of the prior block
17:48 billymg personally i'd like to have those as startup flags that you can pass to the proggy
17:48 whaack but i didn't test this from block 0, and we're indexing into block - 1
17:48 billymg ah, classic lol
17:49 whaack billymg: this should fix it http://paste.deedbot.org/?id=Chyw
17:49 billymg whaack: that fixed it!
17:49 whaack the if height == 0, return true are the two lines you need to add. I will post a vpatch , but maybe add those lines yourself and try again
17:50 billymg seems to be scanning now
17:50 whaack awesome!
17:50 whaack you can try running python trbexplorer.py view-block 0
17:50 billymg what do you think about having the datadirs as flags?
17:51 billymg one prefix assumes trb chain and explorer db are in the same parent directory
17:51 whaack billymg: ah i see, yeah and this case of having them in different directories will be pretty common given the sizes of the dbs
17:52 billymg that view-block command worked fine too, neat!
17:52 whaack well i think environment variables are okay, i don't think it makes sense to pass them to the proggy everytime you run it, and you can always set environ variables in the same line that you start the program if you want to
17:53 whaack but i agree there should be separate variables for the location of the .bitcoin directory and for the location of your trbexplorer db
17:53 billymg yeah, no strong opinion on flag vs env variable
17:54 whaack billymg: every 50 blocks or so there should be a print out of the prediction on how long the sync is going to take, how long does yours say?
17:54 whaack (it's going to underestimate by a lot, but curious to see what it reads)
17:55 billymg "Processing blocks for 3.34939098358 seconds at 14.928087 blocks_per_second per the last 50 blocks, there are 707849blocks remaining, estimated time to completion is 0.0 days, 13.0 hours, 10.0 minutes, and 17.2611667442 seconds."
17:56 whaack ah, if only
17:56 billymg ah, yeah, the estimate jumps around (i think i saw you talking about this in the logs)
17:56 billymg saw one go by for 2 days and change, and the next a day and change
17:57 billymg now 5 days...
17:57 whaack well the scanning is much more steady than trb, but it starts to slow down as the index of txs and addresses gets large
17:57 asciilifeform whaack: left comment on your www, seems to be in spam queue
17:58 billymg whaack: pretty fuckin' cool though
17:59 whaack asciilifeform: approved
17:59 asciilifeform whaack: ty
18:01 whaack billymg: Yup, the best part is you can go into the db via the sqlite3 command line tool and start running your own arbitrary queries
18:01 billymg whaack: do you know if the scanning is CPU bound? i noticed you're using python's threading instead of multiprocessing, iirc the latter lets you use multiple OS threads
18:02 billymg my crawler uses threading only because the only bottleneck there was network io (waiting for node responses), so a single python thread is more than enough
18:02 whaack billymg: I do not know, to be honest, and the threading and setup of the sqlite3 db were written by jfw
18:02 asciilifeform pretty simple algo, will restate ftr: add cmdline flag '-cement=path_to_cement_file'. file is a (signed by producer, verified by noad operator) list of blox #s and corresponding hashes
18:02 dulapbot (therealbitcoin) 2020-08-30 asciilifeform: http://logs.nosuchlabs.com/log/therealbitcoin/2020-08-30#1001100 << imho 'cement' would be useful if implemented compactly; then could feed a node <100MB signed list of hashes and it'll download correct blox through N from the net. but indeed 'less mutilation is best' imho when comes to trb; and if thinking about it, ANY trb node that aint synced to ~current height, will in fact refuse to relay most tx (and
18:04 asciilifeform when requesting next block, if current height < max_cement_height , then request specifically next hash from cement.
18:04 whaack asciilifeform: there are two things going on here, trb's sync from the outer world, and trbexplorer's sync from the local trb
18:04 billymg whaack: ah, perhaps worth taking a look at python's multiprocessing then. i've never used it myself but when i was looking at it seemed to have a very similar API to 'threading'
18:04 asciilifeform whaack: speaking of trb sync per se
18:07 whaack asciilifeform: maybe that's a project i'm willing to take on next
18:08 asciilifeform whaack: imho is a++ project
18:10 asciilifeform asciilifeform's cement maker. note, is buggy, i.e. needs whaack's 'dumpblock' patch to actually produce correct output, as it happens
18:10 whaack billymg: You will also need the dumpblock patch for your trb or you will experience problems scanning
18:15 whaack billymg: if you don't have the dumpblock patch then at some point you're going to request a block from trb and you're going to get back some orphan, and then the scanner is going to get stuck in a loop of adding the orphan and then deleting it back and fourth as it tries to reorg from a detected hash mismatch
18:15 asciilifeform the hygienic way to use 'cement' of course would be, in order of preference, 1) cement from 1 of yer existing noades 2) cement from several of yer l1 folx who agree on 1..n (as they oughta) and all signed
18:16 whaack asciilifeform: I can use my trbexplorer to sign a 2 column file of (block number, hashes) in the near future
18:17 asciilifeform whaack: imho automated signers are a dodgy proposition and at any rate not really needed.
18:18 asciilifeform if folx post up-to-date cement ~yearly, will more than suffice for quick (wks, rather than months) sync
18:23 whaack asciilifeform: I wasn't implying that the signing would be automatic
18:23 asciilifeform a
18:23 asciilifeform certainly would be useful if it could return cement for 0..n, for specified n
18:24 asciilifeform signing/verifying best left to operators' hands tho.
18:25 asciilifeform worth noting that what the prb people do is already equivalent to a (braindamaged implementation of) 'cement', where they request headers 1st, but do so from arbitrary rando automatically, rather than from source specified by operator
18:25 asciilifeform is the only reason prb 'syncs quickly'
18:27 whaack right, but as much as we shit on prb, they actually find solutions to problems (even though they ignore principles)
18:28 asciilifeform this was their 'solution' to 'sync faster!111'
18:28 asciilifeform moar generally, their 'solution' largely consists of 'lusers dun bother to operate noad, keep coin in gox' etc
18:30 whaack i'm not defending them as much as noting that we fail at producing basic stuff, and then constantly have to rely on their tools (like wallets and blockexplorers)
18:32 whaack but looks like if you're right about how much of a speedup the cement code your mentioning will produce, then all the heavy lifting of finding a good solution is done, and the implementation should not be too much of a job
18:32 asciilifeform whaack: can only speak for self, but asciilifeform not relying on prb wallets. as for block exploders, they are useful but imho a luxury, i.e. not actually necessary for handling own tx, but largely for 'voyeurism' of others
18:38 * asciilifeform very much in favour of trb-powered exploder & whaack's experiment. but must point out the obv. fact that while seeing tx you didn't generate yerself is often interesting , you wouldn't want to rely on a 3rdparty exploder to see whether you've been paid
18:41 whaack asciilifeform: that's the point of open sourcing it, so you can have your own local explorer, to facilitate any resarch you wanna do (via sql queries) and to allow yourself to look up any address without inadvertly doxxing yourself
18:41 asciilifeform aha
18:42 asciilifeform ( see also re logical conclusion )
18:42 dulapbot Logged on 2022-01-30 14:23:19 asciilifeform: http://logs.nosuchlabs.com/log/asciilifeform/2022-01-30#1077257 << imho the correct place for a block exploder is ultimately a pseudoserver within trb noad per se, locally
18:43 whaack the public facing apis are for outreach, or easy access when you wanna know something that is not privacy sensitive while away from terminal
18:43 asciilifeform right
18:44 asciilifeform imho trb oughta use a db that's accessible from other process on same box. would then be trivial to query arbitrary addr balances, dissect blox, etc
18:45 whaack billymg: Btw, regarding multithreading, from my experience in my performance-optimization MIT course I took, multithreading is the last step, it adds massive headaches of complexity, and your maximum gain is capped by the number of cores you have.
18:45 asciilifeform whaack: funnily enuff, trb in fact suffers from all of these headaches, w/out any of the win. but you already knew this.
18:46 whaack heh, i know it from reading the logs, but i'm quite unfamiliar with the trb source itself
18:47 asciilifeform whaack: there's a buncha threads, but also locks haphazardly littered around errywhere, so in effect only 1 is able to run at a given time
18:53 billymg whaack: makes sense. like i said my crawler was network i/o bound when single-threaded, adding threading allowed it to send out pings and process results from 100s of nodes simultaneously (whatever you set the max_sockets knob to in the crawler's config)
18:54 billymg i only suggested it because i noticed your code was already using threading (so it already has some of the multithreading complexity added/handled)
18:54 billymg though admit did not read enough to see how you were using it
18:55 billymg and also do not know how direct the translation is from the 'threading' library to the 'multiprocessing' library, probably not 4free in terms of complexity, but idk
~ 1 hours 39 minutes ~
20:34 scoopbot New article on whaack: Podcast Episode 02 - The USDdb and Bitcoin's Speculative Attack
~ 43 minutes ~
21:18 shinohai >tfw one of the girls announces above podcast to me, and pronounces whaack like it rhymes with "quake". xD
21:21 whaack aha, technically it's pronounced walk, since my last name haack is pronounced like hawk, but i usually read it in my own head as whack
~ 17 minutes ~
21:39 whaack off for today, i wanted to make a note here that mpwp's comment form should state that a valid email is not required for commenting
← 2022-02-13 | 2022-02-15 →