IRC log of dig on 2010-03-17

Timestamps are in UTC.

00:28:03 [lkagal]
lkagal (~lkagal@pool-98-110-160-220.bstnma.fios.verizon.net) has joined #dig
00:44:56 [oshani]
oshani (~oshani@31-35-166.wireless.csail.mit.edu) has joined #dig
00:59:05 [oshani]
oshani has quit (Quit: oshani)
02:12:07 [mcherian]
mcherian (~mcherian@c-24-61-8-94.hsd1.ma.comcast.net) has joined #dig
02:25:21 [kennyluck]
kennyluck has quit (Quit: kennyluck)
02:58:08 [oshani]
oshani (~oshani@c-71-233-151-72.hsd1.ma.comcast.net) has joined #dig
03:38:47 [mcherian]
mcherian has quit ()
04:45:11 [Yudai__]
Yudai__ (~yudai@p78be59.kngwnt01.ap.so-net.ne.jp) has joined #dig
08:34:10 [danbri]
danbri has quit (Ping timeout: 248 seconds)
09:03:16 [kennyluck]
kennyluck (~kennyluck@DHCP-21198.iis.sinica.edu.tw) has joined #dig
09:20:57 [oshani]
oshani has quit (Quit: oshani)
09:25:15 [danbri]
danbri (~danbri@unaffiliated/danbri) has joined #dig
09:31:26 [timbl]
timbl has quit (Ping timeout: 245 seconds)
09:39:18 [danbri]
danbri has quit (Quit: Leaving...)
09:54:49 [kennyluck]
kennyluck has quit (Quit: kennyluck)
11:30:40 [Ralph]
Ralph (~swick@30-7-139.wireless.csail.mit.edu) has joined #dig
11:31:04 [Ralph]
Ralph is now known as RalphS
12:45:32 [vinirusso]
vinirusso (~Adium@189.62.51.163) has joined #dig
13:32:26 [vinirusso]
vinirusso has quit (Quit: Leaving.)
13:37:33 [oshani]
oshani (~oshani@c-71-233-151-72.hsd1.ma.comcast.net) has joined #dig
13:41:31 [timbl]
timbl (~timbl@host86-189-17-163.range86-189.btcentralplus.com) has joined #dig
13:59:07 [oshani]
oshani has quit (Quit: oshani)
14:27:47 [kennyluck]
kennyluck (~kennyluck@114-43-121-41.dynamic.hinet.net) has joined #dig
14:47:58 [vinirusso]
vinirusso (~Adium@200-171-89-68.dsl.telesp.net.br) has joined #dig
15:10:33 [oshani]
oshani (~oshani@c-71-233-151-72.hsd1.ma.comcast.net) has joined #dig
15:10:50 [oshani]
oshani has quit (Client Quit)
15:20:13 [timbl]
timbl has quit (Quit: timbl)
15:21:58 [danbri]
danbri (~danbri@unaffiliated/danbri) has joined #dig
15:28:52 [lkagal]
lkagal has quit (Quit: lkagal)
15:43:20 [oshani]
oshani (~oshani@31-35-166.wireless.csail.mit.edu) has joined #dig
15:54:48 [amy]
oshani? you may be interested in this article "EFF Posts Documents Detailing Law Enforcement Collection of Data From Social Media Sites" http://www.eff.org/deeplinks/2010/03/eff-posts-documents-detailing-law-enforcement
15:55:03 [amy]
the EFF is a great site, you probably already subscribe to it
15:55:15 [oshani]
thanks Amy! I'll take a look at it!!
16:05:41 [lkagal]
lkagal (~lkagal@30-6-179.wireless.csail.mit.edu) has joined #dig
16:57:20 [jambo]
jambo (~jambo@w3cdhcp67.w3.org) has joined #dig
19:59:15 [lkagal]
oshani
19:59:19 [lkagal]
Here's the query
19:59:22 [lkagal]
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
19:59:22 [lkagal]
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
19:59:22 [lkagal]
CONSTRUCT { ?CITY<http://app.sst.ll.mit.edu/app#in> <http://app.sst.ll.mit.edu/app/region/West> .
19:59:23 [lkagal]
?CITY <http://app.sst.ll.mit.edu/app#in> ?STATE .}
19:59:23 [lkagal]
WHERE
19:59:23 [lkagal]
{
19:59:23 [lkagal]
?CITY <http://app.sst.ll.mit.edu/app#in> ?STATE.
19:59:23 [lkagal]
?STATE <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://app.sst.ll.mit.edu/app#State>.
19:59:24 [lkagal]
?STATE <http://app.sst.ll.mit.edu/app#in> ?DIVISION.
19:59:24 [lkagal]
?DIVISION <http://app.sst.ll.mit.edu/app#in> <http://app.sst.ll.mit.edu/app/region/West>.
19:59:24 [lkagal]
?CITY rdfs:label 'PAONIA'
19:59:25 [lkagal]
}
19:59:50 [lkagal]
PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
19:59:51 [lkagal]
PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>
19:59:51 [lkagal]
CONSTRUCT { ?CITY<http://app.sst.ll.mit.edu/app#in> <http://app.sst.ll.mit.edu/app/region/West> .
19:59:51 [lkagal]
?CITY <http://app.sst.ll.mit.edu/app#in> ?STATE .}
19:59:51 [lkagal]
WHERE
19:59:52 [lkagal]
{
19:59:52 [lkagal]
?CITY <http://app.sst.ll.mit.edu/app#in> ?STATE.
19:59:52 [lkagal]
?STATE <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://app.sst.ll.mit.edu/app#State>.
19:59:52 [lkagal]
?STATE <http://app.sst.ll.mit.edu/app#in> ?DIVISION.
19:59:53 [lkagal]
?DIVISION <http://app.sst.ll.mit.edu/app#in> <http://app.sst.ll.mit.edu/app/region/West>.
19:59:53 [lkagal]
?CITY rdfs:label 'PAONIA'
19:59:54 [lkagal]
}
20:00:28 [lkagal]
http://pastebin.com/RF2jF3nN
20:03:12 [oshani]
lkagal, from the 4store documentation: "4store's query engine has a "soft limit" which prevents poorly phrased or hard to optimise queries from "running away" and consuming enormous resources. You can change this limit with the --soft-limit parameter, setting it above 1000 will make 4store work harder to try to provide a correct answer to the query, e.g. if you seem to get too few answers to a difficult query, you could try
20:03:12 [oshani]
4s-query --soft-limit 5000 demo 'SELECT ... etc.'"
20:04:30 [oshani]
lkagal, is it possible to add another parameter... fo e.g. ..&soft-limit=2000
20:05:13 [lkagal]
Where ? Inside the sparql builtin ?
20:06:47 [lkagal]
This query doesn't work with 2000 limit http://pastebin.com/Gngzv7Ru
20:07:18 [oshani]
lkagal, I'll check the SPARQL built-in
20:07:30 [lkagal]
Seemed to work with 20000 limit
20:07:57 [oshani]
wait, I'll first ask from 4store folks
20:10:20 [jambo1]
jambo1 (~jambo@31-33-136.wireless.csail.mit.edu) has joined #dig
20:11:06 [oshani]
lkagal, giving -1 will disable the soft limit
20:11:51 [jambo]
jambo has quit (Ping timeout: 245 seconds)
20:22:11 [RalphS]
RalphS has quit (Quit: leaving ...)
20:28:58 [lkagal]
oshani, pipian could you figure out how to do this either by setting some parameter on the server or within the sparql builtin.
20:29:56 [oshani]
lkagal, I tried setting the soft-limit parameter on the server, but apparently it only works with the newest version of 4-store
20:30:21 [oshani]
asked Pipian to modify the built-in so that it'll send soft-limit as a parameter
20:31:43 [Pipian]
Pipian (~pipian@w3cdhcp27.w3.org) has joined #dig
20:32:31 [oshani]
Pipian, you have to add "&soft-limit=-1"
20:33:02 [lkagal]
Thanks
20:35:35 [Pipian]
Alright, try the reasoner now. It should support query parameters in the URL
20:35:38 [Pipian]
e.g.
20:35:52 [Pipian]
<http://air.csail.mit.edu:8000/sparql/?soft-limit=-1>
20:46:18 [oshani]
Pipian, try this query: http://pastebin.com/Gngzv7Ru
20:51:06 [kennyluck]
kennyluck has quit (Ping timeout: 252 seconds)
20:52:17 [lkagal]
Thanks pipian and oshani. Pipian, is the code checked into hg and on air.csail.mit.edu ?
20:54:28 [Pipian]
Yes.
20:56:30 [yosi]
yosi (~chatzilla@96.232.30.44) has joined #dig
20:56:30 [kennyluck]
kennyluck (~kennyluck@114-43-122-236.dynamic.hinet.net) has joined #dig
20:58:44 [yosi]
yosi has quit (Client Quit)
21:08:43 [lkagal]
Thanks Pipian
21:09:13 [charles2]
charles2 (~charles2@24-1-233.dynamic.csail.mit.edu) has joined #dig
21:14:52 [mcherian]
mcherian (Matt@31-33-137.wireless.csail.mit.edu) has joined #dig
21:21:22 [vinirusso]
vinirusso has left #dig
21:22:12 [vinirusso]
vinirusso (~Adium@200-171-89-68.dsl.telesp.net.br) has joined #dig
21:22:41 [vinirusso]
vinirusso has left #dig
21:23:59 [kennyluck]
kennyluck has quit (Quit: kennyluck)
21:30:22 [oshani]
lkagal, Pipian, I just found out that the soft limit I had set on the server is working! (without having to add the soft-limit CGI param)
21:30:39 [oshani]
check this command
21:30:40 [oshani]
curl
21:30:41 [oshani]
'http://air.csail.mit.edu:8000/sparql/?query=PREFIX+rdf%3A+%3Chttp%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23%3E%0D%0APREFIX+rdfs%3A+%3Chttp%3A%2F%2Fwww.w3.org%2F2000%2F01%2Frdf-schema%23%3E%0D%0A%0D%0ACONSTRUCT+%7B+%3FZIP%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%2Fregion%2FWest%3E+.+%0D%0A%3FZIP+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3FCITY+.%0D%0A%3FCITY+%3Chttp%3A%2F%2Fapp
21:30:41 [oshani]
l.mit.edu%2Fapp%23in%3E+%3FSTATE+.%0D%0A%7D%0D%0AWHERE%0D%0A%7B%0D%0A%3FZIP+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3FCITY.%0D%0A%3FCITY+%3Chttp%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23type%3E+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23Place%3E.%0D%0A%3FCITY+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3FSTATE.%0D%0A%3FSTATE+%3Chttp%3A%2F%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23type%3E+%3Chttp%3A%2F%2Fapp.sst.l
21:30:41 [oshani]
du%2Fapp%23State%3E.%0D%0A%3FSTATE+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3FDIVISION.%0D%0A%3FDIVISION+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%23in%3E+%3Chttp%3A%2F%2Fapp.sst.ll.mit.edu%2Fapp%2Fregion%2FWest%3E.+%0D%0A%3FZIP+rdfs%3Alabel+%2781428%27%0D%0A%7D'
21:30:52 [oshani]
and it returns the values
21:31:35 [oshani]
it was a bug in the 4-store query form apparently
21:33:05 [danbri]
(query form bugs apart :)
21:33:12 [danbri]
s/wonders/wanders/
21:33:46 [oshani]
hiya, danbri!
21:33:53 [danbri]
heya
21:36:01 [oshani]
danbri, we were just playing with our SPARQL endpoint (http://air.csail.mit.edu:8000/sparql), and fixing some problems we ran into while query :)
21:36:16 [oshani]
s/query/querying it
21:36:45 [danbri]
we're using Virtuoso currently in NoTube project (well for user activity logs stuff), but also Yves at bbc has been trying out 4store
21:37:01 [danbri]
it's big and fast etc ... he did manage to corrupt his db somehow, but it was a huge dataset
21:37:17 [danbri]
both have bugs, both are fast... so am collecting evidence/gossip :)
21:37:48 [oshani]
ah.. well, we haven't tried out virtuoso, but have heard good things about it :)
21:38:00 [oshani]
setting up 4-store was bit of a pain
21:38:07 [oshani]
it had tons of dependencies!
21:38:23 [danbri]
you can't just apt-get them?
21:38:37 [oshani]
you can, if you are on the right Ubuntu version
21:38:51 [oshani]
we were on an older Ubuntu distro
21:38:53 [danbri]
ahh
21:44:57 [jambo1]
jambo1 has quit (Quit: Leaving.)
21:51:17 [Pipian]
Pipian has quit (Remote host closed the connection)
22:12:22 [vinirusso]
vinirusso (~Adium@200-171-89-68.dsl.telesp.net.br) has joined #dig
22:14:27 [vinirusso]
vinirusso has left #dig
22:48:49 [mcherian]
mcherian has quit (Ping timeout: 265 seconds)
22:53:50 [jambo]
jambo (~jambo@c-98-216-106-112.hsd1.ma.comcast.net) has joined #dig
23:09:31 [charles2]
charles2 has quit (Quit: charles2)
23:22:50 [charles2]
charles2 (~charles2@dhcp-18-111-52-197.dyn.mit.edu) has joined #dig
23:42:55 [oshani]
oshani has quit (Quit: oshani)
23:47:01 [lkagal]
lkagal has quit (Quit: lkagal)
23:47:36 [mcherian]
mcherian (Matt@31-33-137.wireless.csail.mit.edu) has joined #dig
23:47:56 [kennyluck]
kennyluck (~kennyluck@114-43-122-236.dynamic.hinet.net) has joined #dig
23:55:16 [vinirusso]
vinirusso (~Adium@189.62.61.58) has joined #dig
23:56:44 [mcherian]
mcherian has quit (Ping timeout: 258 seconds)