Stremlit App for code generation and push to generated apps.

[NeoAppsAI]

Phase 1: Initial Setup and Basic Functionality
1.1 Setup Streamlit Frontend
Goal: Develop a public-facing frontend where users can submit job requests.
Tasks:
Create a Streamlit application that includes a form for job submission.
Implement CAPTCHA to prevent automated submissions.
Basic form validation to ensure required fields are filled correctly.
1.2 Azure Function Integration
Goal: Implement backend logic to handle form submissions.
Tasks:
Set up an Azure Function to receive HTTP requests from the
Integrate Azure Key Vault to securely retrieve RabbitMQ credentials.
Use Azure Function to send the job request to RabbitMQ for processing.
1.3 RabbitMQ Setup
Goal: Establish a message queue system for job processing.
Tasks:
Set up RabbitMQ on a secure server.
Configure a durable queue to handle incoming job requests.
Implement basic message handling and error logging.
Phase 2: Implement Worker Service and Task Processing
2.1 Worker Service Development
Goal: Develop a worker service that listens to RabbitMQ and processes jobs.
Tasks:
Create a service that listens for messages in RabbitMQ.
Implement job processing logic, including task validation and handling.
Integrate the worker service with the Azure Function to trigger the processing pipeline.
2.2 Docker-Based Task Execution
Goal: Execute job tasks securely in Docker containers within a VM.
Tasks:
Set up a VM environment that can run Docker containers.
Develop Docker containers to perform specific tasks (e.g., code generation, data processing).
Integrate the worker service with the VM to trigger Docker tasks as part of the job processing pipeline.
2.3 Code Generation and Email Notification
Goal: Automatically generate code based on user input and send it via email.
Tasks:
Implement a code generation component within the Docker container.
Develop an email notification system to send the generated code to the user.
Integrate an external email service (e.g., SMTP, SendGrid) to handle outgoing emails.
Phase 3: Advanced Features and Optimization
3.1 Message Queue Management
Goal: Implement mechanisms to manage and clear RabbitMQ messages after task completion.
Tasks:
Develop a RabbitMQ cleaner component to clear messages once tasks are processed.
Implement logging and monitoring for message queue management.
Ensure that the system can handle multiple concurrent job requests and clean up efficiently.
3.2 Security Enhancements
Goal: Strengthen the security of the entire system.
Tasks:
Review and harden the security of the Azure Function and VM environment.
Implement rate limiting, IP tracking, and automated banning for abusive users.
Ensure that RabbitMQ credentials and other sensitive data are never exposed, even in a public repository.
3.3 Scalability and Performance Optimization
Goal: Optimize the system for performance and scalability.
Tasks:
Load test the system to identify bottlenecks and optimize resource allocation.
Implement horizontal scaling for the worker service and VM environments.
Optimize the Docker container performance and reduce task execution time.
Phase 4: Documentation, Community Engagement, and Open Source Release
4.1 Comprehensive Documentation
Goal: Provide clear and comprehensive documentation for developers and users.
Tasks:
Document the architecture, setup process, and usage instructions.
Create C4 model diagrams to visualize the system’s architecture.
Provide examples and tutorials on how to extend or customize the system.

Check the c4 Architecture Diagram for better readability.