Show Idle (>14 d.) Chans
← 2020-02-21 | 2020-02-23 → ↓
10:06 asciilifeform ACHTUNG trb operators! loox like all trb nodes known to me are presently wedged (at 618405)
10:10 shinohai https://www.blockchain.com/btc/block/618405 <<< ~1.32 MB, likely lots of segshit in there.
10:10 asciilifeform classical black hole condition, apparently, and both of mine ate 618406 when reset. still puzzling tho, not seen this sorta thing for past 2+ yrs
10:10 asciilifeform shinohai: this has 0 i
10:10 asciilifeform impact on trb normally
10:11 asciilifeform shinohai: trb dun eat >1e6byte blox under any circumstance
10:11 shinohai Being that ViaBTC mined it, I'm surprised block not empty
10:13 adlai iirc, "prb" was poweranger, not publicrelations
10:16 asciilifeform adlai: i seem to recall both. cant recall which earlier.
~ 18 minutes ~
10:34 asciilifeform anyways -- my 2 now running (but no peer seems to have 618412 atm) . all others in my 'addnode' table still bricks.
10:37 asciilifeform last thought about this 2y ago, but afaik the only practical means to actually debug hypothetical 'magic mempool turd that wedges' would be to keep a ring buffer of all traffic (can reset when successful block eat, erry time) and dump to disk on sigkill
10:37 asciilifeform mod6 ^
10:39 curiousd0g no scaling problem?
10:39 asciilifeform curiousd0g: nope. spam problem, since '15, periodically tho
10:40 curiousd0g solution?
10:40 asciilifeform curiousd0g: prolly variation on malleus theme
10:41 mod6 asciilifeform: yeah, my node seems to be 'blackholed' at the moment. investigating before a restart here.
10:41 asciilifeform mod6: capture the log.
10:42 mod6 as to your thought on debugging, will think on it.
10:42 mod6 while I'm at it, did anyone try out those three new vpatches? I've been running with them just fine on test nodes.
10:42 * shinohai likes being in the derpy alt-bitcoinwizards chan.
10:42 snsabot (trilema) 2019-12-26 mp_en_viaje: in other housekeeping, hey diana_coman lobbes wouldja mind taking alf's derpy alt-bitcoinwizards off the loggers header list ?
10:43 asciilifeform mod6: note that i've no evidence for 'magic packet'. could be easily race condition that pops up erry n yrs..
10:43 asciilifeform shinohai: why ty
10:43 curiousd0g "He who comes to us with a turd, by the turd shall perish."
10:43 curiousd0g lol
10:43 mod6 asciilifeform: my log looks like your log. will provide if you really want to see tho.
10:43 shinohai mod6: I hopefully can try 'em this weekend, it got put on back burner last weekend had a sick concubine to care for.
10:44 mod6 no worries shinohai
10:44 asciilifeform mod6: initially had 4 hypotheses ( 1) magic tx in mempool 2) magic liquishit administered via plain tcp directly to noad 3) peculiarity in block 618406 4) failed reorg in vicinity of 618405 ). elim
10:44 mod6 but do let me know if/when they work for ya.
10:44 asciilifeform eliminated 3 and 4
10:45 asciilifeform ( add 5th -- race condition , for co
10:45 asciilifeform completeness )
10:45 mod6 yeah, i mean, getting blackholed is nothing new. seems like what it is. that's what I would have thought if no one would have said anything.
10:45 * asciilifeform grr will have to swap kbds
10:46 asciilifeform mod6: i dun recall seeing hard wedge on my nodez since early '18
10:47 mod6 quick snippit of my one log looks like this: http://paste.deedbot.org/?id=qWkx
10:48 mod6 i guess generally speaking, if i let this just figure itself out, it usually does. just may take some time. hours usually.
10:48 asciilifeform mod6: typical picture as seen during prolonged block verify. except, continues for hours.
10:48 mod6 ya.
10:48 asciilifeform mod6: i saw last night, decided to hold off ringing the bell until wake up (if still wedged)
10:48 mod6 I think I'm going to restart my main node. And I'm gonna leave my test node in this state. See what happens.
10:48 asciilifeform aite. ty mod6 . lemme know what you find.
10:49 mod6 Sure thing.
10:49 asciilifeform i reset both of mine, they are presently operating ( tho sadly lacking 618412 atm )
10:51 mod6 LoadBlockIndex(): hashBestChain=0000000000000000000358b1f55d0fa15d185693974f0fa1dc3249109151f2b0 height=618405
10:51 mod6 (on restart)
10:52 mod6 So yah, had 618405, was waiting for, or trying to digest 618406
10:52 asciilifeform mod6: both of mine ate through 618411 , currently operating normally (aside from no one offering 618412 to'em of yet)
10:53 asciilifeform ( that is, after reset )
10:53 asciilifeform wedge took place immed. prior to 618406 .
10:54 mod6 SetBestChain: new best=0000000000000000000686f8b07d684d9950f9b017ae1d9774de18c861ccb095 height=618413 work=3994228844468425383327109680
10:54 mod6 ploughing right back up.
10:55 asciilifeform imho mempool ops really oughta have a timeout.
10:55 mod6 i saw the discussion before about txs that sit, often 0 fee. you mean like that?
10:55 asciilifeform (in fact all ops oughta have a 10min timout. on adequate iron, no block verify ever exceeds the block interval. )
10:55 mod6 time out after 2 weeks.
10:56 asciilifeform no
10:56 asciilifeform timeout for externally-received command
10:56 mod6 oh. for msg ops.
10:56 asciilifeform aha
10:58 mod6 maybe so. i'd like to get to the bottom of this weird issue. i kinda see it from time to time. maybe not as broadly impacting as this one tho.
10:58 asciilifeform mod6: when was last time you saw >12h wedge ?
10:58 asciilifeform i haven't since '18
10:59 asciilifeform and can't recall a 'all known trbs hanging' since july of '15
11:00 mod6 heck, i see this kinda thing ... often. log looks just like it does (where I pasted above). thing doesn't respond to RPC commands.
11:00 asciilifeform ( the latter was a reorg . whereas this, nao -- no reorg )
11:00 mod6 needs restart.
11:00 mod6 often tho, just seems to sort itself out after some time.
11:00 asciilifeform mod6: often?! and never said?! tsk
11:01 mod6 i mean, more than since '18, sure. I typically think of these as 'blackholed'. I don't block ips quite like as encouraged on this one particular node. although, i should.
11:02 mod6 but i kinda like it to be beaten harder. per-se.
11:02 asciilifeform mod6: the ips visible in the log aint in any way interesting, necessarily. you get same picture (folx disconnect) whenever verification aint working (because that thread wedged)
11:02 mod6 right
11:02 asciilifeform yer seeing whatever peers you had at the time of wedge
11:03 asciilifeform ( and not necessarily inclusive of the 1 who served you the hypothetical wedge cmd . that 1 could have long disconnected )
11:03 mod6 right. usually by the time I see it too, it's already been going on for a bit. hard to pinpoint.
11:04 mod6 never saw this thing since 18 with dulap?
11:04 asciilifeform folx try to connect to wedged node, you get a 'accepted connection x.x.x.x:x'; then socket no message in first 60 seconds, 1 0
11:04 asciilifeform mod6: nope
11:04 asciilifeform mod6: and since '15 not once such that all known nodes were in this state simult.
11:05 mod6 hm. see I don't think it has anything to do with the block. which is why I try to stay away from 'wedged', unlike the other circumstances where we've said 'wedged'. i forget the block numbers off hand.
11:05 asciilifeform not to do w/ 618406 at any rate
11:05 mod6 there've been a couple of cases where we've all been digging to figure out what the issue was.
11:05 mod6 right.
11:06 mod6 could be a heathen command tho. your dumping the cmds idea could be a helpful tool here.
11:07 mod6 (in debug moad)
11:07 superkuh Fucking apple. Setting their browser to declare any TLS cert with a lifetime of greater than a year to be invalid. Corps gonna corp.
11:07 superkuh https://scotthelme.co.uk/certificate-lifetime-capped-to-1-year-from-sep-2020/
11:07 asciilifeform mod6: well not 'heathen cmd' in the usual sense of 'named cmd unsupported by trb', these get malleus'd
11:07 asciilifeform superkuh: whatcha doing on crapple box ?
11:07 superkuh I'm not.
11:07 superkuh But I do see apple users in my site logs.
11:08 superkuh And they'll be gone now. Not a huge loss given apple users, but still.
11:08 asciilifeform superkuh: take the next step and nix sslism.
11:08 mod6 asciilifeform: well 'magic turd' in there. what have you.
11:08 asciilifeform mod6: supposing not simply race condition.
11:09 mod6 i guess i'd be surprised if that was the problem, a 'magic turd'.
11:09 mod6 perhaps, yeah, could be some sort of weird dead-lock.
11:09 asciilifeform mod6: race cond. seems most likely imho. if 'magic turd' existed, would be served up to all trb daily, i suspect.
11:10 asciilifeform trb really oughta have 'watchdog timer'
↖
11:10 mod6 same. this seems to be something more rare. like I said, I don't see it all the time. but certainly not years between either.
11:10 asciilifeform could be as simple as 'no new blox for 2h? graceful reset'
11:10 mod6 (could just be my noad too, fwiw, doing something weird)
11:11 mod6 now there's a helpful thing too. not sure I'd do it 2h's but, yeah, perhaps some interval.
11:11 asciilifeform user knob
11:13 mod6 (im up to 618529 nao)
11:13 asciilifeform a++
11:13 asciilifeform mod6: i'ma leave this alone until nightfall, lessee
11:13 asciilifeform mine also picking up blox atm
11:14 mod6 yeah, my test node is still derping. will write in when it recovers. won't wait forever, but may wait a few days to see.
11:15 asciilifeform other folx appear to remain in wedge ( trinque et al )
11:15 asciilifeform wonder how long until they notice.
↖
11:16 asciilifeform the main argument against race condition hypothesis, actually, is that all known (to asciilifeform) trb stations affected at afaik same moment
11:16 mod6 agreed.
11:16 asciilifeform typically race cond. does not behave this way, but rather a 'planets align' thing
11:17 shinohai http://logs.nosuchlabs.com/log/asciilifeform/2020-02-22#1007303 <<< will notice when they are given permission to look. xD
11:17 snsabot Logged on 2020-02-22 11:15:24 asciilifeform: wonder how long until they notice.
11:17 asciilifeform !q seen-anywhere trinque
11:17 snsabot trinque last seen in #trilema on 2020-02-08 02:29:49: you're a cunt's dumpster, woof.
11:17 mod6 its possible that 406 just took a long time to verify for some reason, which causes a cascade of other issues that render it derped for a bit.
11:18 asciilifeform shinohai: that 1 might notice , given how often logs in, some time in summer, lol
11:18 shinohai kek
11:18 asciilifeform mod6: took about 40s to verify on .27 (a slow, comparatively, box, 'apu1')
11:18 asciilifeform when unwedged it, that is
11:19 mod6 yeah, fair enough, once restarted, verified very quickly.
11:20 asciilifeform mod6: i considered timeout as early as in '15, but was loathe to bake it, given as it is 'symptomatic cure'
11:22 mod6 yeah, i get that too. this seems like it might be 1 problem or perhaps more likely a confluence of issues that build up at the right time. i'd rather fix that shit, than give it a pill.
11:22 mod6 only way to find out, really, is just to debug and wait for the issue to arise, then disect.
11:23 asciilifeform mod6: the tricky bit is that in order to fix item like this in the proper sense, gotta reproduce on-demand
11:23 mod6 well, once one has an idea of wtf, then yes, can reproduce at will. otherwise, tilt at windmills.
11:23 asciilifeform entirely possib. that it wont recur 'naturally' for another 2y...
11:24 mod6 to >1 trb node, this could be true.
11:24 mod6 in this case.
11:27 asciilifeform BingoBoingo yer still wedged, btw
11:27 * BingoBoingo has trb node 143.202.160.10:8333 sitting at blockheight 618530 at present, but sits on version string 70001
11:27 BingoBoingo asciilifeform: Most of mine wedged, yes
11:27 asciilifeform BingoBoingo: was speaking of what it was you had in the rack aha
11:28 asciilifeform BingoBoingo: just ver string ? or is that actually yer pre-trb experimental thing
11:28 BingoBoingo asciilifeform: Just version string. It's the rotor/stator recipe baked to give the nameservers something to do with their cycles.
11:29 asciilifeform a
11:29 asciilifeform BingoBoingo: do you have dumpblock in there ?
11:30 asciilifeform BingoBoingo: be sure to save the log before resetting any of your wedged ones, also
11:31 asciilifeform ( grab the past 48hrs if you can )
11:32 asciilifeform mod6: atm both of mine at 618417. not wedged, but also not yet seen next block from that.
11:32 BingoBoingo I don't recall if I included dumpblock in the press, Will see if I can get anything interesting out of the logs.
11:32 asciilifeform i'ma leave'em for a bit, see if climbs
11:35 mod6 hmm. ok. keep an eye on it. im on 618530
11:36 mod6 which now, looks like a few blocks behind. 618532 has been announced a few minutes ago.
11:46 BingoBoingo mod6: Which version flag is your node flying and does it sit on port 8333?
11:49 mod6 setvernum=50400
11:49 mod6 I took it offline a minute ago tho.
11:49 adlai http://logs.nosuchlabs.com/log/asciilifeform/2020-02-18#1006913 << i find your prose verbose; long paragraphs jar the eyes of seasoned lispers, so consider using short phrases and headings (similar to org-mode) to increase the chance that your prose actually gets read
11:49 snsabot Logged on 2020-02-18 19:31:19 asciilifeform: verisimilitude: this one ?
11:50 mod6 Will restart it in a minute.
11:51 * adlai intended to link a different line from that same conversation, although there is no need for a correction since the conversation should probably be read along with the article
11:51 asciilifeform adlai: my objection there is a bit different -- just how many loc (and of what) in cl did that fella write, to then 'i'ma propose style guide' ?
11:51 asciilifeform adlai: i wrote maybe 100kloc of cl and do not consider self qualified to tell others 'how to style' in it
11:52 * adlai rarely has any disagreement with asciilifeform, and in this case, no objections to your objections !
11:52 adlai especially, the bit about lispers not caring even one byte specifier about style
11:53 adlai the word 'lispers' here refers to those who actually have to write and maintain the code; managers of teams of programmers are likely to care quite a bit about the optics.
11:54 asciilifeform adlai: there's something to be said for consistent styling (for instance, can auto-conform via emacsism)
11:54 adlai consistent styling also leads to fingerprinting.
11:55 asciilifeform but it is 'cultural' problem, no one man can propose to solve it (unless he writes mega-opus that erryone in fact considers 'foundational' and reads, imitates, as the germans still imitate goethe )
11:55 asciilifeform adlai: lolwat?
11:55 adlai verisimilitude: thank you for the reminder about using loop keywords from the keyword package. this is a habit that i have yet to adopt, although i probably should.
11:55 adlai fingerprinting, i.e. "this code smells like nakamoto"
11:56 asciilifeform adlai: you may've noticed that asciilifeform and erryone he worked/works with, in fact signs his proggies
11:57 asciilifeform i'm quite uninterested in whatever suffering anons face from their idiocy
11:57 adlai you probably work very few net meters of cardboard/cement/etc from cubefarms were people scrub signatures before deploying code.
11:58 adlai possibly even forging signatures and fingerprints to implicate their false flag of choice.
11:59 adlai my guess is that it's much more fun, in the long run, to be able to claim your work as your own, and the suffering anons who can't, gotta console themselves with... dunno, salaries? conference chicken? etc
12:01 asciilifeform adlai: lulzily, today's gen of virii artists often forgets even to remove debug symbols from built bin
12:01 verisimilitude I appreciate your thoughts, adlai.
12:01 asciilifeform ( yes, incl. usg's )
12:01 verisimilitude I wrote my style document, because a fellow in my group wanted to read some, and I was lacking writing ideas.
12:02 asciilifeform verisimilitude: there's nothing wrong w/ writing such thing. but i wanted to state why i would not .
12:02 verisimilitude I neither expect to see nor care if anyone uses my style described therein.
12:03 asciilifeform adlai: and at any rate src styling has 0 to do w/ 'make iran think nk wrote stuxnet' biz
12:05 adlai eh, nobody cares about centrifuges anymore; these days the cool kids are all about that other kind of 'TMSR'
12:06 asciilifeform adlai: is example.
12:06 verisimilitude With no disrespect, adlai, I'm not particularly interested in changing my writing style so. I strive to avoid some circumlocution in my writing, but I'd rather not use headers and whatnot. I write for a very particular constraint, which would've been obvious if you'd seen the document before it was converted to HTML, and I'm uncertain if you'd.
12:08 adlai lemme put it this way: your style guide seems written for recitation to students, rather than quick glances by a working programmer
12:08 verisimilitude That's a good point; I suppose it's not written for quick glances, no.
12:08 adlai (and there is no problem with this! provided that you can find any students who still want to learn lisp...)
12:09 adlai )
12:10 curiousd0g )
12:11 adlai In other news, I do often wonder as to just how amazingly accurate asciilifeform was in once calling the people treating mp, dc, et al as their 21st century Elizae the 'patients'
12:11 asciilifeform adlai: hm?
↖
12:12 adlai also, congratulations are in order for BingoBoingo, both for the birthday, and apparently for turning #ossasepia into another chapter of AA!
12:12 shinohai lmfao
12:12 asciilifeform i always assumed the 'aa' flavour there were deliberate thing
12:13 shinohai Except step 3 isn't "God as you understand him" but "thou shalt have no other deity sans MP".
12:14 asciilifeform see also : 'i was all fucked up on drugs. but then i found jesus. then i was all fucked up on jesus. but it's ok, i'm taking drugs for it'
12:15 adlai http://logs.nosuchlabs.com/log/asciilifeform/2020-02-22#1007379 >> http://logs.nosuchlabs.com/log-search?q=from%3Aasciilifeform+patients&chan=trilema
12:15 snsabot Logged on 2020-02-22 12:11:40 asciilifeform: adlai: hm?
12:16 asciilifeform adlai: but what of it ?
12:16 adlai shinohai: nonononono; "thou shalt have no other used car salesman but pete"
12:19 shinohai pete_d has pretty nice cars, I'd deffo but his shared Lotus if it isn't too ragged out.
12:19 adlai asciilifeform: well, mp claimed in one of the bits of legalese about "bitcoin as game currency, mpex as recursive game" that he's insane; yet look at that parade of 'normal' folks, just lining up to have him and his cohort set them straight about their troubles. it's almost as though the crazy are sane, and the sane -- crazy!
12:19 shinohai s/but/buy
12:19 asciilifeform adlai: understand, this is the biz of folx attending the church, not mine
12:20 asciilifeform atm much moar interested in e.g. potential race wedge in trb, then in what happens in vatican
12:22 * adlai goes back to eating oxford's ru-en+en-ru via retina
12:22 asciilifeform adlai: enjoy
12:22 * asciilifeform will bbl.
12:23 mod6 Node is back up, on block 618539
~ 46 minutes ~
13:10 adlai regrettably their idea of "dictionary" is almost entirely devoid of grammatical reference, so recommendations of particularly good summaries of the usage (either online or in print) would be much appreciated
13:11 * adlai meanwhile starts crawling thru wiktionary
13:13 mod6 My node has fallen 4 blocks behind now, lot more of this in my debug.log: http://paste.deedbot.org/?id=-Rlj
13:17 adlai ah cool, it has finally started to catch up entries from urbandictionary: https://en.wiktionary.org/wiki/Russian
~ 1 hours 30 minutes ~
14:47 mod6 So, ok, restarted my node yet again. This time in debug=true mode.
14:47 mod6 Was caught up, now fell behind. Here's something that ~might~ be of interest...
14:47 * mod6 gathers up logs
15:00 mod6 http://paste.deedbot.org/?id=Oj7N << asciilifeform thoughts?
↖
15:03 mod6 that address 138.197.207.236 is always getting disconnected directly after the flood control message -- a number of times in my 12Gb debug.log file.
15:03 mod6 anyone turn anything else up from that IP that looks "interesting"?
15:16 mod6 http://paste.deedbot.org/?id=l08E << Here's a grep of my log for that IP 4 lines before and after found. Might be just a version 70013 trying to sync. Timing seems odd to that flood control though.
15:30 mod6 Found basically ~same thing on test node with regard to behavior. Different IP's syncing. This time tho, 122 of the 'getdata' commands came in, then a flood control message, then ~32,161 more.
15:30 mod6 Then the weirdness/wedging seems to have started.
15:32 mod6 If anyone sees the same things in your debug.log, please write in.
15:37 * mod6 been looking at this for some time now. Need food. bbs.
~ 1 hours 22 minutes ~
16:59 mod6 back around. will keep checkin' back.
~ 52 minutes ~
17:51 shinohai "Astounding work there asciilifeform, until I put you on shitlist then everything you ever made doesn't matter anymore"
17:52 shinohai The cognitive dissonance of that lot amazes me "because mp says".
~ 25 minutes ~
18:18 feedbot http://qntra.net/2020/02/twitter-bans-bloomberg-campaign-deputy-field-organizers-for-platform-manipulation/ << Qntra -- Twitter Bans Bloomberg Campaign "Deputy Field Organizers" For "Platform Manipulation"
~ 4 hours 32 minutes ~
22:50 asciilifeform mod6: has it occured to you to compare to usual debug output ? you aint wedged. not getting blocks as fast as you like cuz yer connected to a bunch of folx who ~are~. ( if yer node accepts e.g. getinfo cmd, you aint wedged )
22:51 asciilifeform shinohai: lol 'ispless'
22:51 asciilifeform shinohai: y'know, the trollage is for me, but for some reason it's always you who bites, lol
↖
22:55 asciilifeform BingoBoingo: 'great' job 'trb nodes have been wedged' w/out reporting who clued you in or linking to thrd. ( maybe next time will see how long it takes to notice, instead of giving what to crib? ) and et tu, mod6
↖
22:55 snsabot (ossasepia) 2020-02-22 BingoBoingo: In other news, a number of visible trb nodes have been wedged for some time.
22:57 * asciilifeform wonders whether he's the only 1 who actually fucking watches the nodes
23:01 asciilifeform adlai: ever considered doing something useful? even sumthing very simple. e.g. where's yer node ?
23:06 mod6 asciilifeform: I haven't gotten a new block since ~1pm on my last restart.
23:06 mod6 So, I'll clean my log, and restart again. It'll probably catch up a bit, but then we'll see.
23:07 mod6 Granted, could be just doing something wrong. I dunno. From what you're saying to me, sounds like your nodes are back to working 'fine'?
23:07 asciilifeform 205.134.172.27 in my cage is at 618593
23:08 asciilifeform the desk noad still behind, but receiving blox
23:11 mod6 *shrug* we'll see how it goes. just started my node. height = 618545 currently.
23:11 asciilifeform mod6: if you recall, the ancient 'dun connect to >1 from same /24' logic is still in trb. so i rec to add .27 to yer addnode list. that way will get blox from mine even when peers end up on m
23:11 mod6 if it keeps up, great! if not, will publish debug.log.
23:12 asciilifeform ... on mine instead
23:12 mod6 Ok.
23:13 asciilifeform mod6: other thing , i rec to review what 'ordinary' debug log liquishit looks like
23:13 asciilifeform we used to do this regularly, mod6 , you'd see a wedge and 'read clouds' , forgetting that the log ~always~ contains large amt of very similar liquishit
23:14 mod6 yeah, well, was looking for something that might point to why the fuck i wasn't getting any blocks.
23:16 mod6 well, it ~was~ getting blocks, upon immediate restart. then would promptly fall behind, and never get another, meanwhile not accepting any RPC commands.
23:16 asciilifeform mod6: if you aint wedged -- then if aint getting blox, it is because other folx aint sending'em.
23:16 asciilifeform ah so wasn't accepting rpc ?
23:16 mod6 no.
23:16 asciilifeform next time you see this, mod6 , post the log plz.
23:16 mod6 just call 'getinfo' or 'stop' and just hang there in term.
23:16 asciilifeform that, there, is wedge.
23:17 asciilifeform and tcpdump -nnXSs 0 port 8333 plz .
23:18 mod6 i posted the log above, after the 'getdata' onslaught, RPC hang.
23:18 mod6 ok.
23:18 asciilifeform mod6: this one ?
23:18 snsabot Logged on 2020-02-22 15:00:46 mod6: http://paste.deedbot.org/?id=Oj7N << asciilifeform thoughts?
23:18 asciilifeform i dun see any traces of attempted rpc in there
23:20 mod6 let me dig it up
23:21 mod6 need a few minutes
23:23 asciilifeform mod6: i'ma bbl tomorrow.
23:24 asciilifeform until then, rec to 'addnode' as described above, an' let it live
23:24 mod6 http://paste.deedbot.org/?id=E3Yc
23:25 mod6 That doesn't show you much, but it does show that I issued the command after the wave of 'getdata'. It hung there for ~8 hours until I finally killed it off like about 10 minutes ago.
23:25 mod6 alright, have a good night.
← 2020-02-21 | 2020-02-23 → ↑

Random(asciilifeform) | Download hourly DB snapshot | Get Source Code

Theme: Light | Dark | System Default