Running ArchiveTeam's Warrior in Kubernetes

Viewed 80
The post discusses the deployment and usage of ArchiveTeam's Warrior project within a Kubernetes cluster. A user shares their experience of setting it up previously, successfully downloading over 3TB of data in just six days. They highlight how easy it is to launch the project using the provided Docker Compose file. However, some concerns are raised regarding the potential risks and inefficiencies of web scraping, particularly regarding duplicate archiving efforts and the necessity of such projects. The discussion illustrates both the technological possibilities and ethical considerations involved in data archiving.
0 Answers