00:00 |
* |
asciilifeform bbl |
00:00 |
verisimilitude |
I've tried specifying this from the <a> before, but WWW browsers helpfully ignore that, for no reason. |
| |
~ 1 hours 5 minutes ~ |
01:05 |
verisimilitude |
Oh, while it's on mind, I'd appreciate if the RSS feed is only accessed every twelve hours or so; I don't update often enough for more than a few daily checks. |
| |
↖ |
| |
~ 1 hours 22 minutes ~ |
02:28 |
feedbot |
http://mvdstandard.net/2020/05/imperial-college-pantsuit-panic-queen-sacked-for-breaking-zher-own-rules/ << The Montevideo Standard -- "Imperial College" Pantsuit Panic Queen Sacked For Breaking Zher Own Rules |
02:35 |
spyked |
http://logs.nosuchlabs.com/log/asciilifeform/2020-05-05#1011275 <-- done. in other news, I dunno wtf, I set the exact socket knobs for feedbot as snsabot and it still gets stuck somewhere. will have to debug further |
02:35 |
snsabot |
Logged on 2020-05-05 23:57:07 asciilifeform: defo interested. spyked plz add when you get a chance. |
02:35 |
spyked |
asciilifeform, did you set any other options (e.g. rcv timeout) besides the ones in http://www.loper-os.org/pub/logotron/active_disconnect_r3.kv.vpatch ? |
| |
↖ |
02:38 |
spyked |
http://logs.nosuchlabs.com/log/asciilifeform/2020-05-06#1011288 <-- hm. atm there's no per-feed setting for that, it just checks all feeds about once per minute. I could set it a bit higher, but I've already gotten complaints from other users that the (publish->notification) delay is high. |
02:38 |
snsabot |
Logged on 2020-05-06 01:05:38 verisimilitude: Oh, while it's on mind, I'd appreciate if the RSS feed is only accessed every twelve hours or so; I don't update often enough for more than a few daily checks. |
02:40 |
spyked |
so... verisimilitude, if it's really bothersome for you (does it eat up a lot of traffic, or what?), I'll add this to the feature list. |
02:42 |
spyked |
but right now getting the reconnect logic right is top priority, because wtf, I'm basing my schedule on the life of a tcp socket |
| |
~ 1 hours 18 minutes ~ |
04:01 |
verisimilitude |
It's bothersome to me, yes; it makes my logs less pleasant to read. In the latest item, I've told whomever's checking the feed once every two minutes to stop, and I've told people to stop for every five minutes as well. If others don't mind, perhaps a per-site setting could be added, although I understand how burdensome this could be. I won't ask it be prioritized, but I'd appreciate it, spyked. |
| |
↖ |
04:11 |
spyked |
verisimilitude, got it, I'll see how I can make this work. meanwhile if you can use any further info to grep -v (e.g. the IP address that curls that link), I'd be happy to help. |
| |
~ 28 minutes ~ |
04:40 |
verisimilitude |
I don't understand what's meant by that. I typically browse through my HTTP server logs to see the referrers and whatnot; I simply dismiss accesses to the RSS feed and similar such resources if I want to get a less inaccurate idea of how my website's being accessed. If I understand, I'll clarify I don't need any particular help in ignoring feedbot, spyked. |
04:45 |
spyked |
verisimilitude: I meant that I can't solve your problem right away and I don't plan to atm (will review it in ~2 weeks from now, I guess), but I'll help with further info (e.g. feedbot's HTTP-side IP) if you need it. |
04:46 |
spyked |
tbh, I don't see why this is a problem at all. as you said, you can filter the access logs if there's too much noise there. |
04:48 |
spyked |
but in general, I don't see why one'd have expectations wrt access frequency for *any* public resource. |
04:56 |
verisimilitude |
Alright; I understand. I don't need the IP address, no. It's just the ``old-Internet'' vibe, spyked; I can ask the access be reduced and I'd prefer it, so why wouldn't I ask? Were it a great burden, I'd simply deal with it, but if it can be handled maybe two weeks from now, that would be nice. |
04:58 |
verisimilitude |
Since I'm asking for something to be done, feel free to suggest I do something, if wanting, of course. |
| |
~ 38 minutes ~ |
05:36 |
spyked |
verisimilitude, alright, makes sense. re. suggestions, perhaps it'd be useful to add that I personally let awstats do all the work for me, handling log processing and generating site usage reports. I rarely inspect logs manually, usually to see the latest weird that attackers are trying to cook up |
05:42 |
* |
spyked meant particularly webserver access logs |
| |
~ 4 hours ~ |
09:43 |
asciilifeform |
http://logs.nosuchlabs.com/log/asciilifeform/2020-05-06#1011292 << this was the final solution to bot wedges, rather than that |
09:43 |
snsabot |
Logged on 2020-05-06 02:35:56 spyked: asciilifeform, did you set any other options (e.g. rcv timeout) besides the ones in http://www.loper-os.org/pub/logotron/active_disconnect_r3.kv.vpatch ? |
09:44 |
asciilifeform |
spyked: fleanode has a mysterious failure mode where disconnects you but doesn't close yer socket. linked item was my pill for this. |
| |
↖ |
09:49 |
asciilifeform |
http://logs.nosuchlabs.com/log/asciilifeform/2020-05-06#1011297 << you don't dedupe log prior to reading?! wainot? |
09:49 |
snsabot |
Logged on 2020-05-06 04:01:05 verisimilitude: It's bothersome to me, yes; it makes my logs less pleasant to read. In the latest item, I've told whomever's checking the feed once every two minutes to stop, and I've told people to stop for every five minutes as well. If others don't mind, perhaps a per-site setting could be added, although I understand how burdensome this could be. I won't ask it be prioritized, but I'd appreciate it, spyked. |
09:49 |
asciilifeform |
i'd go mad surely, if i did that |
| |
~ 30 minutes ~ |
10:19 |
spyked |
asciilifeform, ty. so if i understood correctly, the sock.recv call always returns after a while, doesn't it? |
10:20 |
* |
spyked will have to dig a bit into cl-irc internals to figure how ircbot behaves there, there's prolly some more obscurity in the cl "stream" abstraction |
10:22 |
spyked |
to be more pedantic: by "returns" I meant "returns or jumps into an exception". iirc the default socket receive timeout is infinite, so I'm wondering if python does some more setup there. |
| |
~ 20 minutes ~ |
10:43 |
asciilifeform |
spyked: in mine, i set it to time out deliberately |
10:44 |
asciilifeform |
it's the 'timeout' constant in the config. |
10:45 |
asciilifeform |
all recv time out after this-many s. |
10:46 |
asciilifeform |
when they time out during normal operation, rather than initial connection (where -- retries),nothing happens |
10:48 |
asciilifeform |
spyked: this is the mechanism you're interested in, i think. |
10:49 |
trinque |
spyked: if you find a way of setting a global socket timeout in sbcl I'd be mighty interested to know! |
10:49 |
spyked |
asciilifeform, setsockopt (in particular the description of SO_RCVTIMEO) says that "The default for this option is zero, which indicates that a receive operation shall not time out." but hm, I'll read your code more carefully and try to determine empirically if this is troo |
10:49 |
asciilifeform |
when one of those timeouts elapses, we check whether we've in fact received anyffin from upstream in the preceding Discon_TO (config constant) seconds. |
10:49 |
asciilifeform |
spyked: default dun timeout, no. i set it. |
10:49 |
spyked |
oh okay |
10:49 |
asciilifeform |
when connecting. |
10:50 |
asciilifeform |
where it's set. |
10:51 |
spyked |
trinque, by 'global' do you mean 'for all sockets owned by the process'? buut.. yeah, I should document this properly, since I've started hacking into SBCL's setsockopt options already |
10:52 |
spyked |
the version I have is missing a few |
10:53 |
asciilifeform |
trinque: afaik you gotta set it :timeout s when opening ea. socket |
10:53 |
trinque |
something like python's socket.setdefaulttimeout would be nice |
10:53 |
trinque |
asciilifeform: aha |
10:54 |
asciilifeform |
trinque: there |
10:56 |
trinque |
yeah, the python one applies to every socket created after the default is set; I know I can set it on each socket |
10:56 |
trinque |
(that was the problem years back with deedbot, slothfully didn't!) |
10:57 |
asciilifeform |
the interesting bit is that i had the timeout in the genesis version, and it in fact didn't help. because of fleanode's peculiar zombie effect. the detector was required to get rid of all wedges. |
10:57 |
snsabot |
Logged on 2020-05-06 09:44:33 asciilifeform: spyked: fleanode has a mysterious failure mode where disconnects you but doesn't close yer socket. linked item was my pill for this. |
10:58 |
asciilifeform |
trinque: my bot created the socket when connecting, and set timeout ea. time |
11:00 |
asciilifeform |
!q uptime |
11:00 |
snsabot |
asciilifeform: time since my last reconnect : 26d 19h 18m |
11:00 |
asciilifeform |
!w uptime |
11:00 |
watchglass |
asciilifeform: time since my last reconnect : 26d 21h 8m |
11:00 |
asciilifeform |
never 1ce had to manually cycle the thing, since that patch . |
11:03 |
asciilifeform |
(it auto-disconnects & reconnects when there's > disc_t seconds of silence from upstream. disc_t in default config is 180 s. ) |
| |
~ 1 hours 50 minutes ~ |
12:53 |
asciilifeform |
!w poll |
12:53 |
watchglass |
Polling 11 nodes... |
12:53 |
watchglass |
143.202.160.10:8333 : Could not connect! |
12:53 |
watchglass |
205.134.172.26:8333 : Alive: (0.021s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
205.134.172.6:8333 : (172-6.core.ai.net) Alive: (0.082s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
108.31.170.3:8333 : (pool-108-31-170-3.washdc.fios.verizon.net) Alive: (0.047s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 (Operator: asciilifeform) |
12:53 |
watchglass |
205.134.172.27:8333 : Alive: (0.084s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 (Operator: asciilifeform) |
12:53 |
watchglass |
205.134.172.4:8333 : (172-4.core.ai.net) Alive: (0.143s) V=70001 (/therealbitcoin.org:0.7.0.1/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
208.94.240.42:8333 : Alive: (0.209s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
213.109.238.156:8333 : Alive: (0.291s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
103.36.92.112:8333 : (terebe.ns01.net) Alive: (0.574s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629237 |
12:53 |
watchglass |
188.121.168.69:8333 : (rev-188-121-168-69.radiolan.sk) Alive: (0.056s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629238 |
12:54 |
watchglass |
192.151.158.26:8333 : Busy? (No answer in 20 sec.) |
13:07 |
asciilifeform |
spyked, trinque : in case still not obv.: there are no 'magic' pythonisms used in the example bot. errything in'ere oughta be 100% portable to anyffin that sits on posix sockets. |
| |
↖ |
13:10 |
asciilifeform |
originally i attempted the bot in ada, but realized that there aint a working sqlism glue for it just yet. hence ended up with that kludge. |
| |
~ 32 minutes ~ |
13:42 |
jurov |
BingoBoingo, I'm not going to please you: http://paste.deedbot.org/?id=N3LB |
13:44 |
BingoBoingo |
jurov: Thank you for letting me know. The only channel I can suggest is the comments on his blog posts. |
13:57 |
jurov |
thebitcoin.foundation/therealbitcoin.org was moved to 95.142.167.185 if anything is broken, i'm responsible |
13:57 |
asciilifeform |
jurov: hrm where's the ml link ? |
13:57 |
asciilifeform |
used to be on the front pg |
14:00 |
jurov |
oh i've removed #t and it somehow went together with it. moment |
14:01 |
asciilifeform |
jurov: btw are you planning to make a dedicated trb chan ? |
14:01 |
asciilifeform |
if so lemme know so i can add it to logotron |
14:01 |
jurov |
yes, later |
14:01 |
asciilifeform |
aite |
14:08 |
asciilifeform |
jurov: ml link back & worx, ty |
14:08 |
asciilifeform |
jurov: is the proggy that ate patches still attached ? |
14:14 |
jurov |
No, the site is completely static. You want to keep posting there? |
14:15 |
asciilifeform |
jurov: not critical. but was wondering whether it still worked. |
14:15 |
jurov |
asciilifeform: it was wired to mailman turd |
14:16 |
asciilifeform |
ah |
14:17 |
jurov |
Will set up the channel shortly and there discuss patch submission. |
14:20 |
asciilifeform |
a++ |
14:21 |
* |
asciilifeform happy to supply logging, and if jurov later wants to set up own instance of such logotron also, will help |
14:22 |
asciilifeform |
jurov: lemme know if you want watchglass in there too . |
14:23 |
asciilifeform |
it doesn't speak unless manually commanded . |
14:26 |
asciilifeform |
!w poll |
14:26 |
watchglass |
Polling 11 nodes... |
14:26 |
watchglass |
143.202.160.10:8333 : Could not connect! |
14:26 |
watchglass |
205.134.172.6:8333 : (172-6.core.ai.net) Alive: (0.022s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
205.134.172.26:8333 : Alive: (0.089s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
205.134.172.27:8333 : Alive: (0.096s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 (Operator: asciilifeform) |
14:26 |
watchglass |
108.31.170.3:8333 : (pool-108-31-170-3.washdc.fios.verizon.net) Alive: (0.098s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 (Operator: asciilifeform) |
14:26 |
watchglass |
205.134.172.4:8333 : (172-4.core.ai.net) Alive: (0.114s) V=70001 (/therealbitcoin.org:0.7.0.1/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
208.94.240.42:8333 : Alive: (0.228s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
213.109.238.156:8333 : Alive: (0.350s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
188.121.168.69:8333 : (rev-188-121-168-69.radiolan.sk) Alive: (0.360s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:26 |
watchglass |
103.36.92.112:8333 : (terebe.ns01.net) Alive: (0.562s) V=99999 (/therealbitcoin.org:0.9.99.99/) Jumpers=0x1 (TRB-Compat.) Blocks=629249 |
14:27 |
watchglass |
192.151.158.26:8333 : Busy? (No answer in 20 sec.) |
14:27 |
* |
asciilifeform finds it pretty handy, not only for monitoring own nodez, but to determine whose nodes actually work, and makes sense to peer with |
14:28 |
asciilifeform |
!w peers 205.134.172.27 |
| |
↖ |
14:28 |
watchglass |
205.134.172.27:8333 : reported peers: 18.141.160.175 23.239.0.21 31.48.249.2 34.219.185.136:9595 34.220.232.128 46.88.183.195 46.229.165.143 65.96.222.54 69.118.65.228 71.34.1.183 |
14:28 |
watchglass |
205.134.172.27:8333 : reported peers: 77.8.57.5 78.99.137.154 78.110.73.83 83.99.245.20 91.45.93.126 91.134.145.202 91.219.25.232 92.117.182.4 93.6.41.59 142.196.232.55 |
14:28 |
watchglass |
205.134.172.27:8333 : reported peers: 174.114.124.12 177.74.189.121 177.96.224.194 177.206.254.253 178.14.17.17 179.113.85.13 190.177.114.36 192.164.247.23 194.14.246.200 199.247.7.208 |
14:28 |
watchglass |
205.134.172.27:8333 : reported peers: 203.129.27.87 208.94.240.42 213.109.238.156 |
14:28 |
asciilifeform |
^ in that vein, also handy . |
| |
~ 3 hours 43 minutes ~ |
18:12 |
verisimilitude |
I read the Apache2 logs directly, asciilifeform, and I don't usually get more than two thousand requests in a day. |
| |
~ 2 hours 27 minutes ~ |
20:39 |
feedbot |
http://mvdstandard.net/2020/05/two-kilometers-of-copper-phone-line-stolen-in-melo-cerro-largo/ << The Montevideo Standard -- Two Kilometers Of Copper Phone Line Stolen In Melo, Cerro Largo |