LLM-Orchestrated Music Production Platform - Generate professional-quality music using AI with natural language prompts.
MusicForge is an AI-powered music production platform that transforms natural language descriptions into full audio tracks. Using a hybrid C#/.NET 9 orchestration layer and Python AI workers, it combines the power of:
- AudioCraft MusicGen - AI music generation
- Bark - AI vocal synthesis
- Demucs - Audio stem separation
- LLM Orchestration - Intelligent task planning via Groq/OpenRouter
"Create an energetic electronic track with a catchy synth melody, 128 BPM"
↓
🎵 Full audio track + stems
| Feature | Description |
|---|---|
| 🎹 Natural Language Control | Describe music in plain English |
| 🤖 LLM Orchestration | AI plans and coordinates generation |
| 🎚️ Stem Separation | Separate vocals, drums, bass, melody |
| 🎤 AI Vocals | Generate realistic vocal tracks |
| 📊 Real-time Progress | SignalR streaming updates |
| 🐳 Docker Ready | One-command deployment |
| 🔌 REST API | Easy integration with any frontend |
┌─────────────────────────────────────────────────────────────────────────────┐
│ MusicForge System │
├─────────────────────────────────┬───────────────────────────────────────────┤
│ C# .NET 9 API Layer │ Python AI Worker Layer │
│ (Port 5001) │ (Port 50051 gRPC) │
├─────────────────────────────────┼───────────────────────────────────────────┤
│ ┌─────────────────────────┐ │ ┌─────────────────────────────────┐ │
│ │ Minimal API + SignalR │ │ │ gRPC Server (MusicWorkerSvc) │ │
│ │ REST + WebSocket │ │ │ │ │
│ └───────────┬─────────────┘ │ └───────────────┬─────────────────┘ │
│ │ │ │ │
│ ┌───────────▼─────────────┐ │ ┌───────────────▼─────────────────┐ │
│ │ MediatR CQRS Layer │ │ │ AI Components │ │
│ │ Commands & Handlers │◄───┼────► • MusicGen (AudioCraft) │ │
│ └───────────┬─────────────┘ │ │ • Bark (Vocals) │ │
│ │ │ │ • Demucs (Stems) │ │
│ ┌───────────▼─────────────┐ │ │ • Theory Engine (music21) │ │
│ │ Agent Orchestrator │ │ └─────────────────────────────────┘ │
│ │ LLM-Powered Planning │ │ │
│ └───────────┬─────────────┘ │ │
│ │ │ │
│ ┌───────────▼─────────────┐ │ │
│ │ SQLite Persistence │ │ │
│ │ EF Core + Repository │ │ │
│ └─────────────────────────┘ │ │
└─────────────────────────────────┴───────────────────────────────────────────┘
| Layer | Technology | Purpose |
|---|---|---|
| API | .NET 9 Minimal API | REST endpoints, SignalR |
| Domain | Clean Architecture | DDD aggregates, value objects |
| Application | MediatR | CQRS command/query handling |
| Infrastructure | gRPC, EF Core | Worker communication, persistence |
| AI Workers | Python 3.11 | MusicGen, Bark, Demucs, music21 |
| LLM | Groq/OpenRouter | Intent parsing, task planning |
| Database | SQLite | Project persistence |
| Container | Docker Compose | Multi-service orchestration |
- Docker & Docker Compose
- Groq API Key (free tier available)
- 8GB+ RAM recommended
- GPU optional (CPU fallback available)
git clone https://github.com/csa7mdm/MusicForge.git
cd MusicForge
# Set your API key
echo "GROQ_API_KEY=your_groq_api_key_here" > .envdocker compose up -d# Create a project
curl -X POST http://localhost:5001/api/projects \
-H "Content-Type: application/json" \
-d '{
"name": "My First Track",
"description": "An energetic electronic track",
"genre": "Electronic",
"mood": "Energetic",
"tempoBpm": 128,
"key": "C Minor",
"durationSeconds": 60
}'
# Generate music
curl -X POST http://localhost:5001/api/projects/{projectId}/generate \
-H "Content-Type: application/json" \
-d '{"prompt": "Create an uplifting intro with synth arpeggios"}'| Method | Endpoint | Description |
|---|---|---|
GET |
/api/health |
Health check |
GET |
/api/health/worker |
Worker health |
GET |
/api/projects |
List all projects |
GET |
/api/projects/{id} |
Get project details |
POST |
/api/projects |
Create new project |
POST |
/api/projects/{id}/generate |
Start generation |
POST |
/api/projects/{id}/iterate |
Iterate with feedback |
DELETE |
/api/projects/{id} |
Delete project |
Create Project
Request:
{
"name": "Summer Vibes",
"description": "A chill summer track",
"genre": "Electronic",
"mood": "Chill",
"tempoBpm": 110,
"key": "F Major",
"durationSeconds": 180,
"hasVocals": true,
"lyrics": "Feel the summer breeze..."
}Response:
{
"projectId": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
"message": "Project created successfully"
}Generate Music
Request:
{
"prompt": "Add a groovy bassline and soft pads"
}Response:
{
"success": true,
"masterFilePath": "/output/summer-vibes-master.wav",
"stemPaths": [
"/output/stems/drums.wav",
"/output/stems/bass.wav",
"/output/stems/melody.wav"
]
}# Run all tests
dotnet test
# Run specific test suites
dotnet test tests/MusicForge.Domain.Tests # 28 tests
dotnet test tests/MusicForge.Application.Tests # 9 tests
dotnet test tests/MusicForge.Integration.Tests # 5 testsTest Coverage:
- Domain Layer: Value objects, entities, aggregates
- Application Layer: Command handlers, state machine
- Integration: API endpoints, worker communication
| Service | Port | Description |
|---|---|---|
api |
5001 | C# REST API |
worker |
50051 | Python gRPC worker |
ollama |
11434 | Optional local LLM |
| Variable | Required | Description |
|---|---|---|
GROQ_API_KEY |
Yes | Groq API key for LLM |
OPENROUTER_API_KEY |
No | Alternative LLM provider |
MusicWorker__Address |
No | Worker address (default: http://worker:50051) |
MusicForge/
├── src/
│ ├── MusicForge.Domain/ # Domain entities, value objects
│ ├── MusicForge.Application/ # CQRS commands, interfaces
│ ├── MusicForge.Infrastructure/ # gRPC, EF Core, LLM clients
│ ├── MusicForge.Api/ # REST API, SignalR hub
│ └── MusicForge.Cli/ # Command-line interface
├── tests/
│ ├── MusicForge.Domain.Tests/
│ ├── MusicForge.Application.Tests/
│ └── MusicForge.Integration.Tests/
├── workers/
│ └── python/
│ ├── src/
│ │ ├── components/ # MusicGen, Bark, Demucs wrappers
│ │ └── server.py # gRPC server
│ └── Dockerfile
├── protos/
│ └── worker.proto # gRPC service definition
└── docker-compose.yml
We welcome contributions! See CONTRIBUTING.md for guidelines.
- Fork the repository
- Create a feature branch:
git checkout -b feature/amazing-feature - Make your changes
- Run tests:
dotnet test - Commit:
git commit -m 'Add amazing feature' - Push:
git push origin feature/amazing-feature - Open a Pull Request
Found a bug? Please open an issue with:
- Title: Clear, concise description
- Steps to reproduce: Numbered list
- Expected behavior: What should happen
- Actual behavior: What actually happens
- Environment: OS, Docker version, .NET version
- Logs: Relevant error messages
Use the Bug Report Template.
This project is licensed under the MIT License - see the LICENSE file for details.
- AudioCraft - Meta's audio generation
- Bark - Suno's text-to-speech
- Demucs - Meta's source separation
- music21 - MIT's music theory toolkit
Built with ❤️ for the music creation community
