IRC log of dig on 2010-11-03
Timestamps are in UTC.
- 00:34:41 [marisol]
- marisol has quit (Quit: marisol)
- 00:39:51 [melvster]
- melvster has quit (Remote host closed the connection)
- 00:40:11 [melvster]
- melvster (~melvster@p5797F2C3.dip.t-dialin.net) has joined #dig
- 01:06:18 [timbl]
- timbl has quit (Ping timeout: 272 seconds)
- 02:05:09 [melvster]
- melvster has quit (Ping timeout: 250 seconds)
- 02:50:06 [oshani]
- oshani has quit (Quit: Mama nidi!)
- 03:40:16 [lkagal]
- lkagal (~lkagal@pool-96-237-240-136.bstnma.fios.verizon.net) has joined #dig
- 04:22:54 [lkagal]
- lkagal has quit (Quit: lkagal)
- 04:29:27 [nunnun]
- nunnun is now known as nunnun_away
- 04:54:51 [nunnun_away]
- nunnun_away is now known as nunnun
- 05:15:24 [kennyluck]
- kennyluck (~kennyluck@accormercurelyon0472836996.pck.nerim.net) has joined #dig
- 05:15:27 [kennyluck]
- kennyluck has quit (Excess Flood)
- 05:17:09 [kennyluck]
- kennyluck (~kennyluck@accormercurelyon0472836996.pck.nerim.net) has joined #dig
- 05:41:13 [timbl]
- timbl (~timbl@93-158-28-241.subs.ibrowse.com) has joined #dig
- 06:52:27 [timbl]
- timbl has quit (Quit: timbl)
- 07:08:46 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 07:17:56 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 07:22:24 [IvanHerman]
- IvanHerman (~ivan@83.160.85.48) has joined #dig
- 07:25:47 [IvanHerman]
- IvanHerman has quit (Client Quit)
- 07:25:58 [IvanHerman]
- IvanHerman (~ivan@83.160.85.48) has joined #dig
- 07:26:21 [timbl]
- timbl has quit (Quit: KUTGW)
- 07:26:41 [IvanHerman]
- IvanHerman has quit (Client Quit)
- 07:26:56 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 07:27:05 [IvanHerman]
- IvanHerman (~ivan@83.160.85.48) has joined #dig
- 07:27:12 [kennyluck]
- kennyluck has quit (Quit: kennyluck)
- 07:28:56 [tlr]
- tlr has quit (Ping timeout: 240 seconds)
- 07:29:24 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 07:35:31 [timbl]
- timbl has quit (Read error: Connection reset by peer)
- 07:35:52 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 07:44:35 [tlr]
- tlr has quit (Ping timeout: 265 seconds)
- 07:57:39 [timbl]
- timbl has quit (Ping timeout: 240 seconds)
- 07:59:10 [melvster]
- melvster (~melvster@p5797F2C3.dip.t-dialin.net) has joined #dig
- 08:05:55 [kennyluck]
- kennyluck (~kennyluck@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 08:31:17 [kennyluck]
- kennyluck has quit (Ping timeout: 255 seconds)
- 08:33:52 [kennyluck]
- kennyluck (~kennyluck@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 08:35:31 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 08:38:51 [danbri]
- danbri has quit (Quit: This computer has gone to sleep)
- 08:47:33 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 08:47:37 [nunnun]
- nunnun is now known as nunnun_away
- 09:03:54 [danbri]
- danbri (~danbri@note-guus2.few.vu.nl) has joined #dig
- 09:03:54 [danbri]
- danbri has quit (Changing host)
- 09:03:54 [danbri]
- danbri (~danbri@unaffiliated/danbri) has joined #dig
- 09:13:49 [tlr]
- tlr has quit (Quit: tlr)
- 09:16:07 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 09:16:20 [tlr]
- tlr has quit (Client Quit)
- 09:22:05 [timbl]
- timbl has quit (Quit: timbl)
- 09:25:32 [mhausenblas]
- mhausenblas (~mhausenbl@147.67.241.226) has joined #dig
- 09:57:53 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 10:08:49 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 10:11:05 [amy]
- amy (~amy@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 10:14:20 [tlr]
- tlr has quit (Ping timeout: 255 seconds)
- 10:26:20 [timbl]
- timbl has quit (Ping timeout: 252 seconds)
- 10:29:07 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 10:29:30 [danbri]
- danbri has quit (Quit: This computer has gone to sleep)
- 10:46:44 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 11:22:09 [nunnun_away]
- nunnun_away is now known as nunnun
- 11:32:55 [tlr]
- tlr has quit (Quit: tlr)
- 11:33:01 [danbri]
- danbri (~danbri@unaffiliated/danbri) has joined #dig
- 11:37:50 [timbl]
- timbl has quit (Quit: timbl)
- 11:42:47 [webr3]
- webr3 has quit (Ping timeout: 252 seconds)
- 11:43:41 [marisol]
- marisol (~marisol@pool-141-154-117-35.bos.east.verizon.net) has joined #dig
- 12:47:16 [marisol]
- marisol has quit (Quit: marisol)
- 13:08:18 [melvster]
- melvster has quit (Ping timeout: 272 seconds)
- 13:10:11 [tlr]
- tlr (~tlr@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 13:13:58 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 13:26:25 [webr3]
- webr3 (~nathan@host81-155-254-169.range81-155.btcentralplus.com) has joined #dig
- 13:52:36 [marisol]
- marisol (~marisol@pool-151-203-34-132.bos.east.verizon.net) has joined #dig
- 13:56:26 [timbl]
- timbl has quit (Ping timeout: 264 seconds)
- 13:56:47 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 14:02:31 [lkagal]
- lkagal (~lkagal@pool-96-237-240-136.bstnma.fios.verizon.net) has joined #dig
- 14:12:18 [nunnun]
- nunnun has quit (*.net *.split)
- 14:33:39 [nunnun]
- nunnun (~nunnun@irc.v6.nunnun.jp) has joined #dig
- 14:33:40 [gbot30]
- gbot30 has quit (Excess Flood)
- 14:34:06 [gbot30]
- gbot30 (~gbot30@config.fsf.org) has joined #dig
- 14:47:26 [mcherian]
- mcherian (~mathew@c-24-61-8-94.hsd1.ma.comcast.net) has joined #dig
- 15:04:23 [melvster]
- melvster (~melvster@p5797EFDA.dip.t-dialin.net) has joined #dig
- 15:11:10 [presbrey]
- tabulator: http://www.heppnetz.de/ontologies/goodrelations/20100916/v1.owl
- 15:11:10 [presbrey]
- Serializer: Should be no loops _:n112
- 15:11:10 [presbrey]
- No stack available.
- 15:22:46 [timbl]
- Hmmm
- 15:29:39 [timbl_]
- timbl_ (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 15:29:39 [timbl]
- timbl has quit (Read error: Connection reset by peer)
- 15:29:41 [timbl_]
- timbl_ is now known as timbl
- 15:29:59 [timbl]
- Why on earth would it have a problem with loops?
- 15:30:59 [timbl]
- (and why no stack available?)
- 15:41:30 [danbri]
- hey timbl, if i was making a foaf crawler in .js, what are the main useful things i could borrow from tabulator src?
- 15:41:43 [danbri]
- (well foaf + skos + other people-related bits and pieces of linked data)
- 15:43:23 [presbrey]
- danbri, going for breadth I assume?
- 15:46:02 [danbri]
- ultimately, for relevance
- 15:46:24 [danbri]
- find people that are somehow close (coauthors/coworkers, interested in same topic, ...) then scoop up a bunch of rdf into a local store
- 15:46:47 [danbri]
- otherwise the crawler dissapears off into livejournal.com foaf, which would take about a year to load up :)
- 15:47:02 [timbl]
- All of rdflib.js I guess
- 15:47:14 [timbl]
- This is running in the browser, right?
- 15:48:29 [danbri]
- yup
- 15:48:40 [danbri]
- so i copied rdflib.js and got rdf/xml parsing from it
- 15:48:46 [danbri]
- i'm not quite sure what else is in there :)
- 15:52:17 [presbrey]
- wow
- 15:52:38 [webr3]
- you could first set up some rules/selectors based on the initial profile, so that if somebody is encountered who know you, or knows the people you know, or is interested in the same thing, then they are stored - only go out to a specific depth and then present findings
- 15:53:25 [presbrey]
- how long does it take?
- 15:53:26 [webr3]
- so if you have :me :interested :something, you set up a filter which will keep triples which match [] :interested :something
- 15:54:03 [timbl]
- What is the goal of the excercise?
- 15:56:45 [presbrey]
- how are you refreshing the network? starting from the beginning? tagging extent boundaries for visitors with free reign?
- 15:58:33 [timbl]
- timbl has quit (Ping timeout: 252 seconds)
- 16:01:22 [danbri]
- re wow, this was pulled thru a php proxy sadly (didn't do the browser trust/permissions thing, and CORS isn't widely out there yet); note to self: make the proxy cache (and pre-parse)
- 16:01:57 [presbrey]
- do it in python
- 16:02:07 [danbri]
- timbl, goal of the exercise is to re-explore notion of a limited web crawl, and a personal sparql store of useful/relevant facts
- 16:02:08 [timbl]
- timbl (~timbl@82.50-14-84.ripe.coltfrance.com) has joined #dig
- 16:02:18 [danbri]
- oops
- 16:02:18 [danbri]
- [17:02] <danbri> timbl, goal of the exercise is to re-explore notion of a limited web crawl, and a personal sparql store of useful/relevant facts
- 16:03:03 [danbri]
- i don't need all of delicious, all of twitter, all of identica or facebook, flickr in a single store; but pulling in ~1000 people's worth of stuff seems workable, and gets away from doing scary distributed query work
- 16:03:23 [danbri]
- (also it's an excuse for me to update my js knowhow)
- 16:04:00 [webr3]
- could you not just make the sparql queries auto GET data it needs?
- 16:10:55 [timbl]
- Net is flakey here
- 16:11:32 [timbl]
- Where do you store the triples?
- 16:11:41 [timbl]
- or do you thorow tem away as you crawl a th emoment?
- 16:17:17 [danbri]
- timbl, at moment i'm consulting the triples then discarding; hope is to test-drive in browser Indexed Database storage
- 16:17:23 [danbri]
- ideally implemented by webr3 :)
- 16:19:30 [mhausenblas]
- IvanHerman, there should be a report available *very* soon - sorry, the NDA I had to sign is too strict ;)
- 16:19:44 [IvanHerman]
- ok
- 16:25:36 [mhausenblas]
- as soon as I'm allowed, I will blog about it, promise
- 16:29:25 [mhausenblas]
- but I think it is fair to say (and also general consensus) that timbl's 5 star plan will be the foundation of what (hopefully) will come
- 16:33:37 [mcherian]
- mcherian has quit (Ping timeout: 252 seconds)
- 16:44:09 [melvster]
- melvster has quit (Remote host closed the connection)
- 16:44:29 [melvster]
- melvster (~melvster@p5797EFDA.dip.t-dialin.net) has joined #dig
- 16:48:06 [IvanHerman]
- mhausenblas: yeay:-)
- 16:48:42 [mhausenblas]
- hehe, that was the least Nigel, Jonathan and I were able to do :D
- 16:52:01 [danbri]
- :)
- 16:54:54 [mhausenblas]
- gtg now - ttyl
- 16:54:58 [mhausenblas]
- mhausenblas has quit (Quit: brb)
- 16:56:58 [mcherian]
- mcherian (~mathew@c-24-61-8-94.hsd1.ma.comcast.net) has joined #dig
- 17:05:24 [timbl]
- timbl has quit (Quit: timbl)
- 17:05:36 [tlr]
- tlr has quit (Quit: tlr)
- 17:06:41 [IvanHerman]
- IvanHerman has quit (Quit: bye guys)
- 17:21:01 [marisol]
- marisol has quit (Quit: marisol)
- 17:37:26 [presbrey]
- ericP, any thought about swobjects sparql update against an abstract storage engine?
- 17:37:49 [ericP]
- background, but nothing concrete
- 17:38:06 [ericP]
- sorry, been preoccupied with rdb2rdf
- 17:38:18 [ericP]
- (which would be an example of a sparql update against an abstract storage engine?)
- 17:38:24 [presbrey]
- ok
- 17:38:41 [presbrey]
- maybe you can help with rdf2rdb next
- 17:39:09 [presbrey]
- might help with what I'm asking
- 17:39:26 [presbrey]
- so our problem is that
- 17:39:46 [presbrey]
- the only common storage 'engine' between swobjects and other RDF toolsets is FILE/turtle
- 17:40:23 [presbrey]
- so in providing SPARUL support, storage engine/performance is fundamentally limited
- 18:02:15 [ericP]
- yeah, i like this sqllite strategy
- 18:09:18 [marisol]
- marisol (~marisol@pool-151-203-34-132.bos.east.verizon.net) has joined #dig
- 18:23:16 [timbl]
- timbl (~timbl@93-158-31-102.subs.ibrowse.com) has joined #dig
- 18:30:04 [amy]
- amy has quit (Quit: bye)
- 18:54:36 [webr3]
- rdf2indexeddb is one I'm going to have to hit v soon
- 18:55:08 [webr3]
- possibly, applicationcache may moot the need though - will see
- 19:08:53 [mcherian]
- mcherian has quit (Ping timeout: 245 seconds)
- 19:18:05 [presbrey]
- webr3, make sure you look at several existing implementations eg. librdf and soon swobjects
- 19:18:40 [presbrey]
- we already have trouble mixing implementations with the same stores
- 20:10:06 [kennyluck]
- kennyluck has quit (Ping timeout: 272 seconds)
- 21:10:58 [kennyluck]
- kennyluck (~kennyluck@accormercurelyon0472836996.pck.nerim.net) has joined #dig
- 22:17:35 [danbri]
- danbri has quit (Quit: Leaving)
- 22:18:14 [marisol]
- marisol has quit (Quit: marisol)