- This event has passed.
Alt Data Council: Web Data Collection and Interacting with Robots.TXT
April 13, 2021 @ 11:00 am - 12:00 pm
|Tuesday, April 13|
11:00 AM - 12:00 PM
The Robots Exclusion Protocol, often called “robots.txt,” is used by websites to communicate with web crawlers and other web robots, or “bots”. It can signal to the web robot which areas of the website should not be processed or scanned. This presentation given by seasoned legal technology professionals Stacey Brandenburg and Jeff Landis of ZwillGen will help practitioners understand what they need to consider when they encounter Robots.txt in the wild, and possible implications of various decisions.