Open Source Python Internet Software

Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium. Please use docker-compose to one-click to start up. By doing so, you don't even have to configure MongoDB database. The frontend app interacts with the master node, which communicates with other components such as MongoDB, SeaweedFS and worker nodes. Master node and worker nodes communicate with each other via gRPC (a RPC framework). Tasks are scheduled by the task scheduler module in the master node, and received by the task handler module in worker nodes, which executes these tasks in task runners. Task runners are actually processes running spider or crawler programs, and can also send data through gRPC (integrated in SDK) to other data sources, e.g. MongoDB.

A complete server platform for business: web, database, portal, ecommerce, intranet, office, email, virtual office/VPN, security, groupware, CMS, CRM, workflow. Apache, LAMP, WAMP, J2EE, Zope, Webware,Perl,Python, jk2, portal kit, portlet, accounting/ERP

A drop-in framework for adding tagging (folksonomy) capabilities to existing applications

CAjax is a library for building AJAX style web applications, which consists of a javascript package for easy writing object-oriented AJAX logic in javascript, and a set of server-side packages dealing with unified communication details.

Publish and subscribe messaging for the Web, and related tools. Our license is BSD.