# Diagram

## Components
- Packaging Files
- Validation Modules
- Marketplace Fetch Modules
- Data Storage
- Internal Components
- External Services
- Postgres Database
- AWS S3 Bucket
- Marketplace API Client

## Files
- [setup.py](https://github.com/squid-sec/vscavator-fetch/blob/main/setup.py)  
- [requirements.txt](https://github.com/squid-sec/vscavator-fetch/blob/main/requirements.txt)  
- [validate_data.py](https://github.com/squid-sec/vscavator-fetch/blob/main/validate_data.py)  
- [util.py](https://github.com/squid-sec/vscavator-fetch/blob/main/util.py)  
- [fetch_extensions.py](https://github.com/squid-sec/vscavator-fetch/blob/main/fetch_extensions.py)  
- [fetch_releases.py](https://github.com/squid-sec/vscavator-fetch/blob/main/fetch_releases.py)  
- [fetch_reviews.py](https://github.com/squid-sec/vscavator-fetch/blob/main/fetch_reviews.py)  
- [vscavator.py (Orchestration)](https://github.com/squid-sec/vscavator-fetch/blob/main/vscavator.py)  
- [CI/CD Pipeline (GitHub Actions)](https://github.com/squid-sec/vscavator-fetch/blob/main/.github/workflows/pylint.yml)  
- [Integration Tests](https://github.com/squid-sec/vscavator-fetch/blob/main/integration_tests.py)

## Data Processing/Validation
- triggers
- initiates
- fetches from
- calls
- processes using
- stores metadata in
- uploads raw files to
- monitors
- tests
- supports
- includes