more scalable 'agent'-based approach - #2

Open

afri wants to merge 20 commits into

danbri:masterfrom

Commits on Oct 21, 2010

linked other rdfapi

danbri
authored and
afri
committed
27d548c
commented out some logging, and display current fetching url in status bar

danbri
authored and
afri
committed
21933a2
updateStatus(s) working

danbri
authored and
afri
committed
0d36734
100 concurrent now, not 10. Added some timing code from Alex.

danbri
authored and
afri
committed
aac466a
floating menu w/ css

danbri
authored and
afri
committed
bcccdcb
factoidal

danbri
authored and
afri
committed
e535c31
sort of limiting images to a gallery of 10. whole app seems to hang a lot >

danbri
authored and
afri
committed
aba6711
oopsie, try/catch works better.

danbri
authored and
afri
committed
bd9d96d
replaceChild args were reversed

danbri
authored and
afri
committed
53b0cd9
less noisy output

danbri
authored and
afri
committed
742500e

Commits on Oct 25, 2010

added timeout of 8s for urls (thanks alex, again)

danbri
authored and
afri
committed
dc541a5
minimised textual output. hid the poorly-named sources counter.

danbri
authored and
afri
committed
ead3e1e
skiplist for images too.

danbri
authored and
afri
committed
d8bab70
google sgapi todo

danbri
authored and
afri
committed
4947448
agent based crawler
afri
committed
7e9d5ff
Improve queue filling logic (remove unnecessary hold()).
afri
committed
3a648f8

Commits on Oct 26, 2010

improve queue capping logic.
afri
committed
fdc8ac0
more work on agent_crawler.
afri
committed
86db75f
Fix oni-apollo path.
afri
committed
6c4d806
collapse console.
afri
committed
1a2cfac