github-backup-automation-system

Shardendu Mishra - Software Developer

Please enable JavaScript to view the full portfolio experience.

Loading projects...

github-backup-automation-system

A compact Go-based system that clones, archives, and stores GitHub repositories into a single backup repo and exposes a Postgres-backed dashboard for visibility.

View Demo View Code

System Active

Observatory v4.1 • Verified

Tech Stack

linuxssh-multiplexinggitautomationgo

Description

GitHub Backup Observatory

Overview

The GitHub Backup Observatory is a compact, multi-service architecture designed to clone, archive, and consolidate GitHub repositories into a singular, unified backup repository. Built for reliability and observability, the system integrates a Go-based CLI worker, a Go and PostgreSQL-powered REST API and WebSocket backend, a Next.js frontend dashboard for real-time monitoring, and an AI-driven Agentic Observatory.

Live Resources

Live Dashboard: github.mishrashardendu22.is-a.dev

Video Demonstration: YouTube

Architecture Overview

This repository operates as a monorepo containing the following core services:

1.Worker (CLI): The root-level Go application responsible for the core logic. It traverses target GitHub accounts, deduplicates repositories, verifies remote HEAD hashes, executes shallow clones, and archives the repositories to a centralized _Repos Git repository.

2.Backend API (`backend/`): A Go-based web server integrated with PostgreSQL. It serves operational metrics, historical run data, and real-time logs via REST APIs and WebSockets.

3.Frontend Dashboard (`frontend/`): A Next.js application providing a comprehensive, real-time user interface for monitoring backup executions, performance metrics, and system logs.

4.Agentic Observatory (`agentic-observatory/`): A Python-based agentic layer utilizing FastAPI and OpenRouter to autonomously analyze and interact with the backup data.

Core Engine: Worker (CLI)

The primary backup engine resides in the root directory. It leverages a lightweight SQLite database for local state management and metadata tracking.

github-backup-automation-system

View Demo View Code

github-backup-automation-system

overview

README.md

GitHub Backup Observatory

Overview

Live Resources

Live Dashboard: github.mishrashardendu22.is-a.dev

Video Demonstration: YouTube

Architecture Overview

This repository operates as a monorepo containing the following core services:

2.Backend API (`backend/`): A Go-based web server integrated with PostgreSQL. It serves operational metrics, historical run data, and real-time logs via REST APIs and WebSockets.

3.Frontend Dashboard (`frontend/`): A Next.js application providing a comprehensive, real-time user interface for monitoring backup executions, performance metrics, and system logs.

4.Agentic Observatory (`agentic-observatory/`): A Python-based agentic layer utilizing FastAPI and OpenRouter to autonomously analyze and interact with the backup data.

Core Engine: Worker (CLI)

The primary backup engine resides in the root directory. It leverages a lightweight SQLite database for local state management and metadata tracking.

Loading projects...

github-backup-automation-system | Projects

Back to Projects