seirdy.one
~seirdy via indexing
christine.website
~ols via indexing
#8 Security Headers
~ols filed ticket on veri todo
#7 Proper cache (make use of HTMLContent)
#6 Add date scraped
ac28c77 add dev instance to readme
add dev instance to readme
~ols pushed to ~ols/veri-docs git
New mailing list added
c2d90a2 Add example workflow
Add example workflow
8b07327 Add example workflow
f8cb27b Change name in usage
Change name in usage
~ols pushed to ~ols/veri-scrape git
#5 Custom user agent
#4 Respect robots.txt
#3 Add tier (1st, 2nd, etc) to database for ranking
#2 Write output to database
#1 Add concurrency