Upload 299 files

CURSOR_UPDATE_PROMPT.md

@@ -0,0 +1,741 @@
+### Cursor Agent Prompt – UPDATE ONLY (no rewrite!)
+
+Fix HF models, complete providers/resources, and integrate JSON registries into UI
+
+You are working on an existing project called **Crypto Intelligence Hub** (the `final/` project the user uploaded).
+
+It is already a full FastAPI + HTML/JS dashboard designed to run as a **Hugging Face Docker Space**.
+
+> 🚨 CRITICAL WARNING – THIS IS AN UPDATE, NOT A REWRITE
+>
+> * Do **NOT** rewrite the architecture.
+> * Do **NOT** introduce new frameworks.
+> * Do **NOT** delete or replace major modules.
+> * Do **NOT** simplify logic by removing features.
+>   Your job is to **fix, complete, and wire up** what is already there, and **leverage the new JSON files** the user added.
+
+---
+
+## 1. Existing structure (do not change high-level architecture)
+
+Repository root contains (focus on these, do not move them):
+
+* `final/hf_unified_server.py`
+
+  * ASGI entry point for the Docker Space:
+
+    ```python
+    from api_server_extended import app
+    ```
+
+* `final/api_server_extended.py`
+
+  * Main FastAPI application:
+
+    * Endpoints:
+
+      * `/api/market`, `/api/trending`, `/api/news`, `/api/sentiment`
+
+      * `/api/providers`, `/api/resources`, `/api/models/*`
+
+      * `/api/diagnostics/*`, `/api/endpoints`, `/api/logs/*`, `/api/pools`
+
+      * `/health`, `/api/status`, etc.
+
+    * SQLite DB at `data/database/crypto_monitor.db`:
+
+      * `prices`
+
+      * `sentiment_analysis`
+
+      * `news_articles`
+
+    * Mounts static files and HTML templates.
+
+    * Defines `WORKSPACE_ROOT` and config paths.
+
+* `final/ai_models.py`
+
+  * Hugging Face model registry and pipeline manager:
+
+    * Uses env: `HF_MODE`, `HF_TOKEN`, etc.
+
+    * Holds `MODEL_SPECS`, logical groups:
+
+      * `CRYPTO_SENTIMENT_MODELS`
+
+      * `FINANCIAL_SENTIMENT_MODELS`
+
+      * `SOCIAL_SENTIMENT_MODELS`
+
+      * `NEWS_SENTIMENT_MODELS`
+
+    * Provides `ModelRegistry`, `initialize_models()`, `get_pipeline()`, `ensemble_crypto_sentiment(...)`, etc.
+
+* `final/config.py`
+
+  * Declares base HF model IDs in `HUGGINGFACE_MODELS`, including:
+
+    * `"crypto_sentiment": "ElKulako/cryptobert"`
+
+    * `"sentiment_financial": "ProsusAI/finbert"`
+
+    * Other sentiment/summarization models.
+
+* `final/templates/index.html`
+
+* `final/templates/unified_dashboard.html`
+
+  * Main "Ultimate" dashboard HTML:
+
+    * Tabs: Market, Monitor, Admin, HF, Pools, Logs, Resources, Reports, Advanced.
+
+    * Dark/glass style visual layout.
+
+* `final/static/js/app.js`
+
+  * Main front-end logic:
+
+    * Tab switching: `switchTab`, `loadTabData`.
+
+    * Data loaders: `loadMarketData`, `loadModels`, `loadSentimentModels`, `loadSentimentHistory`, `loadNews`, `loadProviders`, `loadDiagnostics`, `loadAPIEndpoints`, etc.
+
+    * Calls backend endpoints under `/api/...`.
+
+* `final/static/css/main.css`
+
+  * Main CSS for dashboard styling.
+
+* `final/api-resources/`
+
+  * Contains JSON resource files (but some code paths still expect other JSON names/locations).
+
+You must work within this architecture. Do not introduce React/Vue, do not move to a new server entry, etc.
+
+---
+
+## 2. New JSON files that MUST be used
+
+The user has added **three important JSON files** that you must integrate into the backend and UI:
+
+1. `providers_config_extended.json`
+
+   * Extended registry of providers (CoinGecko, CoinPaprika, explorers, DeFi, etc.).
+
+   * Contains detailed metadata: `category`, `base_url`, `endpoints`, `rate_limit`, `requires_auth`, `priority`, `weight`, etc.
+
+2. `PROVIDER_AUTO_DISCOVERY_REPORT.json`
+
+   * Auto-discovery validation report:
+
+   * Contains:
+
+     * `stats`: counts of HTTP/HF providers, valid/invalid/conditional, execution time, etc.
+
+     * `http_providers.results[]`: each with:
+
+       * `provider_id`, `provider_name`, `provider_type`, `category`
+
+       * `status` (`VALID`, `INVALID`, `CONDITIONALLY_AVAILABLE`)
+
+       * `requires_auth`, `auth_env_var`, `error_reason`, `test_endpoint`, `response_time_ms`, `response_sample`.
+
+   * This is a **runtime validation snapshot** that must be exposed in the UI (e.g., as a diagnostics/providers health section).
+
+3. `all_apis_merged_2025.json`
+
+   * Master registry of APIs and keys:
+
+     * `metadata`: name, version (`2025.11.11`), description, created_at, source_files.
+
+     * `raw_files[]`: with big config text, free CORS proxies, RPC nodes, explorers, market data APIs, etc.
+
+   * This should back **API Explorer / Resources UI**, showing:
+
+     * Categories (market data, explorers, RPC, etc.).
+
+     * Example endpoints and usage.
+
+     * Possibly mention of CORS proxy patterns.
+
+> You must **explicitly use these three files** in backend endpoints and update the UI to surface this information in a structured, useful way.
+
+---
+
+## 3. Known problems you must fix (without rewriting)
+
+### 3.1 HF models: 401, invalid IDs, 0 loaded pipelines
+
+Logs show:
+
+* For `ElKulako/cryptobert` and `ProsusAI/finbert`:
+
+  * 401 / Repository Not Found.
+
+  * Expired user access token `DreammakerCryptoSignalAndTrader2`.
+
+* Registry ends up with:
+
+  ```text
+  'models_loaded': 0, 'failed': [...]
+  ```
+
+But `HF_MODE` gets reported as `'public'` or `'partial'`.
+
+Problem:
+
+* Some configured models are private/gated/not accessible with current token.
+
+* Token is expired.
+
+* The registry says "partial/public" but in practice, **no usable pipelines** exist.
+
+### 3.2 Providers config path & resources mismatch
+
+In `api_server_extended.py`:
+
+```python
+PROVIDERS_CONFIG_PATH = WORKSPACE_ROOT / "providers_config_extended.json"
+```
+
+Previously, this file did not exist in the project – causing `/api/providers` to return an empty/minimal list.
+
+Also, resources endpoints reference JSON filenames like:
+
+* `crypto_resources_unified_2025-11-11.json`
+
+* `all_apis_merged_2025.json` (or similar)
+
+But the actual files and paths in the `final/` project were not aligned.
+
+### 3.3 Placeholders and half-implemented endpoints
+
+* `/api/pools` returns a static empty list + "not yet implemented" message.
+
+* Some diagnostics endpoints are present but not fully wired to UI.
+
+### 3.4 HTML tabs vs JS logic mismatch
+
+`static/js/app.js` expects tab IDs like:
+
+```js
+'dashboard', 'market', 'models', 'sentiment', 'news', 'providers', 'diagnostics', 'api-explorer'
+```
+
+But `templates/index.html` / `unified_dashboard.html` defines tabs like:
+
+```html
+'market', 'monitor', 'admin', 'hf', 'pools', 'logs', 'resources', 'reports', 'advanced'
+```
+
+Thus:
+
+* Tabs such as `'hf'`, `'pools'`, `'logs'`, `'resources'`, `'reports'`, `'advanced'` have **no corresponding JS case**.
+
+* Tabs such as `'models'`, `'sentiment'`, `'diagnostics'`, `'api-explorer'` exist in JS but **not in HTML**.
+
+Result: Many features (models UI, providers UI, diagnostics UI, API explorer) are effectively invisible or non-functional.
+
+### 3.5 Sentiment UI ID/function mismatch
+
+HTML:
+
+* Uses `id="sentimentInput"`, `id="sentimentResult"`, `id="sentimentDetails"`.
+
+* Button calls `onclick="runSentiment()"`.
+
+JS:
+
+* Expects `id="sentiment-text"`, `id="sentiment-mode"`, `id="sentiment-model"`, `id="sentiment-result"`.
+
+* Main handler is `analyzeSentiment()`.
+
+Result: clicking the button throws `runSentiment is not defined`, and DOM IDs do not align.
+
+### 3.6 Missing containers for models/providers/diagnostics/API explorer
+
+* `app.js` renders into elements like `#models-list`, `#models-status`, `#providers-list`, `#api-endpoint-list`, etc.
+
+* These IDs are not present in `index.html`, or are named differently.
+
+Result: even if backend endpoints work, UI has nowhere to render them.
+
+---
+
+## 4. Tasks – with explicit use of the new JSON files
+
+### 4.1 Backend – HF models & registry hardening (ai_models.py, config.py, api_server_extended.py)
+
+* Keep the **existing structure and logic**, but:
+
+1. Implement robust auth and fallback:
+
+   * Respect `HF_MODE` (`off`, `public`, `auth`).
+
+   * In `"public"` mode:
+
+     * Do not rely on any expired or invalid token.
+
+     * Call `transformers.pipeline(...)` without `use_auth_token` or with a safe fallback.
+
+   * In `"auth"` mode:
+
+     * Use `HF_TOKEN` from env if present.
+
+     * If token is missing/invalid, log a concise warning, mark those models as failed, but do **not** crash startup.
+
+2. Per-task fallback chain:
+
+   * For each logical category:
+
+     * Crypto sentiment (`CRYPTO_SENTIMENT_MODELS`).
+
+     * Financial sentiment (`FINANCIAL_SENTIMENT_MODELS`).
+
+     * Social sentiment, news sentiment, summarization, etc.
+
+   * Define an ordered list of **public, reliable** model candidates.
+
+   * `initialize_models()` and `get_pipeline()` should try candidates in order and pick the first that loads.
+
+   * If all candidates in the chain fail:
+
+     * Register a clear `failed` entry in registry.
+
+     * Expose this failure cleanly via `/api/models/status` and `/api/models/list`.
+
+3. Registry & endpoints:
+
+   * `/api/models/status` should return:
+
+     * `status`: `"ok"`, `"partial"`, or `"disabled"`.
+
+     * `hf_mode`, `models_loaded`, `failed` with concise messages.
+
+   * `/api/models/list` should list **logical tasks** (e.g., `crypto_sent_0`, `financial_sent_0`) and indicate:
+
+     * Whether each is loaded.
+
+     * Underlying model ID.
+
+     * Any note (e.g., "requires HF auth", "fallback used").
+
+4. Make sure sentiment endpoints:
+
+   * `/api/sentiment/analyze`
+
+   * `/api/hf/run-sentiment`
+
+   * Any ensemble endpoints
+
+   correctly use the `ModelRegistry` and handle "no available model for this task" without crashing, returning a structured error to the UI.
+
+> Do NOT delete existing task groups or endpoints – only strengthen and complete them.
+
+---
+
+### 4.2 Backend – integrate `providers_config_extended.json`
+
+You **must** integrate this file as the primary providers registry.
+
+1. Locate `providers_config_extended.json` in the repo.
+
+   * If not already under `final/`, move or reference it there.
+
+   * Recommended path: `final/providers_config_extended.json`.
+
+2. In `api_server_extended.py`:
+
+   * Confirm or set:
+
+     ```python
+     PROVIDERS_CONFIG_PATH = WORKSPACE_ROOT / "providers_config_extended.json"
+     ```
+
+   * Fix `load_providers_config()` to:
+
+     * Load this JSON file.
+
+     * Validate that `config["providers"]` exists and is a dict.
+
+     * Return structured provider data.
+
+3. Update `/api/providers`:
+
+   * Use `providers_config_extended.json` to return a list of providers with fields like:
+
+     * `id` (key).
+
+     * `name`.
+
+     * `category`.
+
+     * `base_url`.
+
+     * `priority`.
+
+     * `weight`.
+
+     * `requires_auth`.
+
+     * `rate_limit`.
+
+   * Optionally include a computed `status` if you correlate with the auto-discovery report (see 4.3).
+
+4. Make sure `/api/providers` is **non-empty** and reflects the JSON content.
+
+---
+
+### 4.3 Backend – integrate `PROVIDER_AUTO_DISCOVERY_REPORT.json`
+
+You must expose the auto-discovery report as part of the diagnostics / providers health.
+
+1. Choose a path, e.g.:
+
+   ```python
+   AUTO_DISCOVERY_REPORT_PATH = WORKSPACE_ROOT / "PROVIDER_AUTO_DISCOVERY_REPORT.json"
+   ```
+
+2. Add or update endpoint(s) in `api_server_extended.py`, for example:
+
+   * `GET /api/providers/auto-discovery-report`:
+
+     * Returns the parsed JSON from `PROVIDER_AUTO_DISCOVERY_REPORT.json` (or a structured subset).
+
+   * Optionally `GET /api/providers/health-summary`:
+
+     * Returns a simplified summary:
+
+       * `total_active_providers`, `http_valid`, `http_invalid`, `hf_valid`, etc.
+
+       * Aggregated counts by `status` (`VALID`, `INVALID`, `CONDITIONALLY_AVAILABLE`).
+
+3. Optionally link provider configs to the discovery report:
+
+   * When constructing `/api/providers` output:
+
+     * If a provider ID from `providers_config_extended.json` appears in `http_providers.results[]`, merge:
+
+       * `status`, `requires_auth`, `error_reason`, `test_endpoint`, `response_time_ms`.
+
+4. Ensure these endpoints are resilient:
+
+   * If file is missing, return a clear error with `"ok": false`, `"error": "report file not found"`.
+
+   * If JSON parse fails, return an error message instead of raising.
+
+---
+
+### 4.4 Backend – integrate `all_apis_merged_2025.json` as a resources/API explorer source
+
+You must wire this file to the **resources/API explorer** endpoints.
+
+1. Place or reference `all_apis_merged_2025.json` under `final/`, e.g.:
+
+   ```python
+   API_REGISTRY_PATH = WORKSPACE_ROOT / "all_apis_merged_2025.json"
+   ```
+
+2. In `api_server_extended.py`, create or update endpoints such as:
+
+   * `GET /api/resources/apis`:
+
+     * Returns:
+
+       * `metadata` from the JSON (`name`, `version`, `description`, `created_at`).
+
+       * High-level categories extracted from the text and structure (market data, explorers, RPC nodes, CORS proxies, etc.).
+
+   * `GET /api/resources/apis/raw`:
+
+     * Returns a trimmed version of `raw_files[]` (filename + first N characters) to avoid huge payloads.
+
+   * If you already have `/api/resources`, consider merging:
+
+     * Existing resources.
+
+     * The structured info from this registry into a single consolidated response.
+
+3. You do **not** need to fully parse all free-form text; focus on:
+
+   * Surfacing metadata.
+
+   * Providing an overview of categories.
+
+   * Exposing some example endpoints and usage hints to the UI.
+
+---
+
+### 4.5 Frontend – align tabs and use the new backend endpoints
+
+In `templates/index.html` and `static/js/app.js`:
+
+1. **Synchronize tab IDs** between HTML and JS:
+
+   * For each visible tab button, make sure `switchTab('...')` uses a `tabId` that `loadTabData` recognizes.
+
+   Example mapping (you can refine but it must be consistent):
+
+   * `market` → `loadMarketData()`.
+
+   * `hf` → `loadModels()` + HF diagnostics (models status, HF mode).
+
+   * `resources` → call a new `loadResources()` that fetches `/api/resources/apis` and/or `/api/resources`.
+
+   * `logs` / `advanced` → call `loadDiagnostics()` and `loadAPIEndpoints()`.
+
+2. Either:
+
+   * Update `loadTabData` to handle `'hf'`, `'resources'`, `'logs'`, `'reports'`, `'advanced'`, `'monitor'`, `'admin'`.
+
+   **OR**
+
+   * Change HTML to use IDs that JS already expects (`models`, `providers`, `diagnostics`, `api-explorer`).
+
+   **But in any case, every tab shown in HTML must have a corresponding case in JS.**
+
+3. After this change:
+
+   * Clicking each tab must trigger at least one data-loading function and update UI.
+
+---
+
+### 4.6 Frontend – sentiment UI fix (and usage of models)
+
+You must make the sentiment panel fully functional using the backend models.
+
+1. In HTML (`index.html`):
+
+   * Decide on final IDs and stick to them. For example:
+
+     ```html
+     <textarea id="sentiment-text"></textarea>
+     <select id="sentiment-mode">...</select>
+     <select id="sentiment-model">...</select>
+     <button onclick="analyzeSentiment()">Analyze Sentiment</button>
+     <div id="sentiment-result"></div>
+     <pre id="sentiment-details"></pre>
+     ```
+
+   * Or adapt JS to current IDs – just ensure both HTML and JS match.
+
+2. In `app.js`:
+
+   * Implement `analyzeSentiment()` (or `runSentiment()` that calls it) to:
+
+     * Read user input from the sentiment textarea and selectors.
+
+     * POST to the appropriate endpoint:
+
+       * `/api/sentiment/analyze` or `/api/hf/run-sentiment`.
+
+     * Render:
+
+       * A high-level label: positive/negative/neutral.
+
+       * Score/confidence.
+
+       * Any additional metadata.
+
+   * Use the **model registry** endpoints (e.g., `/api/models/list`) to populate the `sentiment-model` select with available sentiment models.
+
+3. Make sure:
+
+   * If no models are available for the chosen task, show a clear warning in the UI rather than crashing.
+
+---
+
+### 4.7 Frontend – providers & auto-discovery UI (using the new JSON-driven endpoints)
+
+You must build UI that actually visualizes:
+
+* Providers from `providers_config_extended.json` (via `/api/providers`).
+
+* Auto-discovery status from `PROVIDER_AUTO_DISCOVERY_REPORT.json` (via new endpoints from section 4.3).
+
+1. In HTML (probably under **HF** or **Resources** or a dedicated **Providers** section):
+
+   * Add containers like:
+
+     ```html
+     <div id="providers-panel">
+       <div id="providers-summary"></div>
+       <table id="providers-list">...</table>
+     </div>
+
+     <div id="providers-health-panel">
+       <div id="providers-health-summary"></div>
+       <table id="providers-health-table">...</table>
+     </div>
+     ```
+
+2. In `app.js`:
+
+   * Implement or update `loadProviders()` to:
+
+     * Call `/api/providers` and render:
+
+       * Name, category, base_url, requires_auth, priority/weight.
+
+     * Call `/api/providers/auto-discovery-report` (or the endpoint you defined) and render:
+
+       * Total valid/invalid/conditional.
+
+       * A table listing provider_id, status, requires_auth, response_time_ms, error_reason, etc.
+
+3. Use simple but clear CSS from `main.css` to style the tables with:
+
+   * Status badges (`VALID` / `INVALID` / `CONDITIONALLY_AVAILABLE` with distinct styles).
+
+   * Highlight providers that are both present in config and validated successfully.
+
+---
+
+### 4.8 Frontend – API Explorer & Resources UI using `all_apis_merged_2025.json`
+
+Under a suitable tab (e.g. **Resources**, **Advanced**, or a specific **API Explorer** tab):
+
+1. In HTML:
+
+   * Add containers like:
+
+     ```html
+     <section id="api-registry-section">
+       <div id="api-registry-metadata"></div>
+       <div id="api-registry-categories"></div>
+       <div id="api-registry-examples"></div>
+     </section>
+     ```
+
+2. In `app.js`:
+
+   * Implement `loadAPIRegistry()` or reuse `loadAPIEndpoints()` by extending it:
+
+     * Fetch `/api/resources/apis` (or `/api/resources` if merged) to get:
+
+       * `metadata` (name, version, description).
+
+       * High-level category descriptors.
+
+     * Render:
+
+       * Title & version.
+
+       * A list of main categories (market data, explorers, RPC, CORS proxy, etc).
+
+       * A small sample of example endpoints and usage patterns from `all_apis_merged_2025.json`.
+
+3. Optionally:
+
+   * Provide a small search/filter box to filter endpoints by keyword.
+
+   * Provide a "copy example URL" button.
+
+---
+
+### 4.9 CSS – keep style, polish where needed
+
+In `static/css/main.css`:
+
+* Without changing the design language, ensure:
+
+  * Newly-added panels (Providers, Auto-discovery, API Registry) have proper spacing, typography, and responsive behavior.
+
+  * Status labels for providers use distinct colors/icons.
+
+  * Loading and error states are visually clear (e.g., `.loading`, `.error-message` styles).
+
+Do not introduce new libraries; just extend existing CSS.
+
+---
+
+## 5. Constraints & style rules
+
+* Work **only** within:
+
+  * `final/api_server_extended.py`
+
+  * `final/ai_models.py`
+
+  * `final/config.py` (only small, safe updates)
+
+  * `final/templates/index.html` (and `unified_dashboard.html` if shared)
+
+  * `final/static/js/app.js`
+
+  * `final/static/css/main.css`
+
+  * Plus minor additions to wire in the three JSON files.
+
+* Do **NOT**:
+
+  * Delete or move `hf_unified_server.py`, `api_server_extended.py`, or `app.py`.
+
+  * Introduce new frameworks (no React/Vue).
+
+  * Replace the HTML with a completely new page.
+
+  * Remove existing endpoints or DB tables.
+
+* Do:
+
+  * Use the three JSON files as **authoritative data sources**:
+
+    * `providers_config_extended.json` for `/api/providers`.
+
+    * `PROVIDER_AUTO_DISCOVERY_REPORT.json` for providers diagnostics.
+
+    * `all_apis_merged_2025.json` for API explorer/resources.
+
+  * Keep HF model logic, but harden and complete it.
+
+  * Make all UI tabs functional and wired to their backend endpoints.
+
+  * Ensure the models that are pipelined are actually used in the sentiment and AI-related UI.
+
+---
+
+## 6. Acceptance criteria
+
+1. HF models & registry:
+
+   * Server boots without unhandled exceptions, even if some models are unavailable/private.
+
+   * At least one sentiment model is loaded in `"public"` mode if public models are accessible.
+
+   * `/api/models/status` and `/api/models/list` correctly reflect loaded and failed models.
+
+2. Providers & resources:
+
+   * `/api/providers` returns a list based on `providers_config_extended.json`.
+
+   * Auto-discovery endpoints expose data from `PROVIDER_AUTO_DISCOVERY_REPORT.json`.
+
+   * `/api/resources/apis` (or equivalent) uses `all_apis_merged_2025.json`.
+
+3. UI:
+
+   * All visible tabs call appropriate JS loaders and show content.
+
+   * Sentiment panel works end-to-end:
+
+     * User enters text → backend analyzes → UI shows label & score.
+
+   * HF/models tab shows model status and availability.
+
+   * Providers tab shows:
+
+     * Config providers list (name, category, base_url, auth requirement).
+
+     * Auto-discovery health summary & per-provider status.
+
+   * Resources/API explorer tab shows metadata + example APIs from `all_apis_merged_2025.json`.
+
+4. No regressions:
+
+   * Market/price charts still work.
+
+   * No new JS errors appear in normal user flows.
+
+Once all of the above are satisfied, stop.
+

api_server_extended.py

@@ -35,7 +35,8 @@ WORKSPACE_ROOT = Path("/app" if Path("/app").exists() else (Path("/workspace") i
 DB_PATH = WORKSPACE_ROOT / "data" / "database" / "crypto_monitor.db"
 LOG_DIR = WORKSPACE_ROOT / "logs"
 PROVIDERS_CONFIG_PATH = WORKSPACE_ROOT / "providers_config_extended.json"
-APL_REPORT_PATH = WORKSPACE_ROOT / "PROVIDER_AUTO_DISCOVERY_REPORT.json"
+AUTO_DISCOVERY_REPORT_PATH = WORKSPACE_ROOT / "PROVIDER_AUTO_DISCOVERY_REPORT.json"
+API_REGISTRY_PATH = WORKSPACE_ROOT / "all_apis_merged_2025.json"
 
 # Ensure directories exist
 DB_PATH.parent.mkdir(parents=True, exist_ok=True)
@@ -156,26 +157,53 @@ def get_price_history_from_db(symbol: str, limit: int = 10) -> List[Dict[str, An
 
 # ===== Provider Management =====
 def load_providers_config() -> Dict[str, Any]:
-    """Load providers from config file"""
+    """Load providers from providers_config_extended.json"""
     try:
         if PROVIDERS_CONFIG_PATH.exists():
-            with open(PROVIDERS_CONFIG_PATH, 'r') as f:
-                return json.load(f)
+            with open(PROVIDERS_CONFIG_PATH, 'r', encoding='utf-8') as f:
+                config = json.load(f)
+                # Validate structure
+                if not isinstance(config, dict):
+                    logger.warning("Providers config is not a dict, returning empty")
+                    return {"providers": {}}
+                if "providers" not in config:
+                    logger.warning("Providers config missing 'providers' key, adding it")
+                    config["providers"] = {}
+                return config
+        logger.warning(f"Providers config file not found at {PROVIDERS_CONFIG_PATH}")
+        return {"providers": {}}
+    except json.JSONDecodeError as e:
+        logger.error(f"JSON decode error loading providers config: {e}")
         return {"providers": {}}
     except Exception as e:
-        print(f"Error loading providers config: {e}")
+        logger.error(f"Error loading providers config: {e}")
         return {"providers": {}}
 
 
 def load_apl_report() -> Dict[str, Any]:
-    """Load APL validation report"""
+    """Load APL validation report (alias for auto-discovery report)"""
+    return load_auto_discovery_report()
+
+def load_auto_discovery_report() -> Dict[str, Any]:
+    """Load PROVIDER_AUTO_DISCOVERY_REPORT.json"""
+    try:
+        if AUTO_DISCOVERY_REPORT_PATH.exists():
+            with open(AUTO_DISCOVERY_REPORT_PATH, 'r', encoding='utf-8') as f:
+                return json.load(f)
+        return {}
+    except Exception as e:
+        logger.error(f"Error loading auto-discovery report: {e}")
+        return {}
+
+def load_api_registry() -> Dict[str, Any]:
+    """Load all_apis_merged_2025.json"""
     try:
-        if APL_REPORT_PATH.exists():
-            with open(APL_REPORT_PATH, 'r') as f:
+        if API_REGISTRY_PATH.exists():
+            with open(API_REGISTRY_PATH, 'r', encoding='utf-8') as f:
                 return json.load(f)
         return {}
     except Exception as e:
-        print(f"Error loading APL report: {e}")
+        logger.error(f"Error loading API registry: {e}")
         return {}
 
 
@@ -241,10 +269,16 @@ async def lifespan(app: FastAPI):
     _provider_state["providers"] = config.get("providers", {})
     print(f"✓ Loaded {len(_provider_state['providers'])} providers from config")
     
-    # Load APL report
-    apl_report = load_apl_report()
+    # Load auto-discovery report
+    apl_report = load_auto_discovery_report()
     if apl_report:
-        print(f"✓ Loaded APL report with validation data")
+        print(f"✓ Loaded auto-discovery report with validation data")
+    
+    # Load API registry
+    api_registry = load_api_registry()
+    if api_registry:
+        metadata = api_registry.get("metadata", {})
+        print(f"✓ Loaded API registry: {metadata.get('name', 'unknown')} v{metadata.get('version', 'unknown')}")
     
     # Initialize AI models
     try:
@@ -374,7 +408,7 @@ async def get_status():
         "total_providers": len(providers),
         "validated_providers": validated_count,
         "database_status": "connected",
-        "apl_available": APL_REPORT_PATH.exists(),
+        "apl_available": AUTO_DISCOVERY_REPORT_PATH.exists(),
         "use_mock_data": USE_MOCK_DATA
     }
 
@@ -503,11 +537,14 @@ async def get_sentiment():
 
 @app.get("/api/resources")
 async def get_resources():
-    """Get resources summary for HTML dashboard"""
+    """Get resources summary for HTML dashboard (includes API registry metadata)"""
     try:
+        # Load API registry for metadata
+        api_registry = load_api_registry()
+        metadata = api_registry.get("metadata", {}) if api_registry else {}
+        
         # Try to load resources from JSON files
         resources_json = WORKSPACE_ROOT / "api-resources" / "crypto_resources_unified_2025-11-11.json"
-        all_apis_json = WORKSPACE_ROOT / "all_apis_merged_2025.json"
         
         summary = {
             "total_resources": 0,
@@ -539,6 +576,7 @@ async def get_resources():
         return {
             "success": True,
             "summary": summary,
+            "api_registry_metadata": metadata,
             "timestamp": datetime.now().isoformat()
         }
     except Exception as e:
@@ -554,6 +592,97 @@ async def get_resources():
             "timestamp": datetime.now().isoformat()
         }
 
+@app.get("/api/resources/apis")
+async def get_resources_apis():
+    """Get API registry from all_apis_merged_2025.json"""
+    registry = load_api_registry()
+    
+    if not registry:
+        return {
+            "ok": False,
+            "error": "API registry file not found",
+            "message": f"Registry file not found at {API_REGISTRY_PATH}"
+        }
+    
+    metadata = registry.get("metadata", {})
+    raw_files = registry.get("raw_files", [])
+    
+    # Extract categories from raw file content (basic parsing)
+    categories = set()
+    for raw_file in raw_files[:5]:  # Limit to first 5 files for performance
+        content = raw_file.get("content", "")
+        # Simple category detection from content
+        if "market data" in content.lower() or "price" in content.lower():
+            categories.add("market_data")
+        if "explorer" in content.lower() or "blockchain" in content.lower():
+            categories.add("block_explorer")
+        if "rpc" in content.lower() or "node" in content.lower():
+            categories.add("rpc_nodes")
+        if "cors" in content.lower() or "proxy" in content.lower():
+            categories.add("cors_proxy")
+        if "news" in content.lower():
+            categories.add("news")
+        if "sentiment" in content.lower() or "fear" in content.lower():
+            categories.add("sentiment")
+        if "whale" in content.lower():
+            categories.add("whale_tracking")
+    
+    # Provide trimmed raw files (first 500 chars each)
+    trimmed_files = []
+    for raw_file in raw_files[:10]:  # Limit to 10 files
+        content = raw_file.get("content", "")
+        trimmed_files.append({
+            "filename": raw_file.get("filename", ""),
+            "preview": content[:500] + "..." if len(content) > 500 else content,
+            "size": len(content)
+        })
+    
+    return {
+        "ok": True,
+        "metadata": {
+            "name": metadata.get("name", ""),
+            "version": metadata.get("version", ""),
+            "description": metadata.get("description", ""),
+            "created_at": metadata.get("created_at", ""),
+            "source_files": metadata.get("source_files", [])
+        },
+        "categories": list(categories),
+        "raw_files_preview": trimmed_files,
+        "total_raw_files": len(raw_files),
+        "source": "all_apis_merged_2025.json"
+    }
+
+@app.get("/api/resources/apis/raw")
+async def get_resources_apis_raw():
+    """Get raw files from API registry (trimmed to avoid huge payloads)"""
+    registry = load_api_registry()
+    
+    if not registry:
+        return {
+            "ok": False,
+            "error": "API registry file not found"
+        }
+    
+    raw_files = registry.get("raw_files", [])
+    
+    # Return trimmed versions (first 1000 chars each, max 20 files)
+    trimmed = []
+    for raw_file in raw_files[:20]:
+        content = raw_file.get("content", "")
+        trimmed.append({
+            "filename": raw_file.get("filename", ""),
+            "preview": content[:1000] + "..." if len(content) > 1000 else content,
+            "full_size": len(content)
+        })
+    
+    return {
+        "ok": True,
+        "files": trimmed,
+        "total_files": len(raw_files),
+        "showing": min(20, len(raw_files)),
+        "source": "all_apis_merged_2025.json"
+    }
+
 
 @app.get("/api/trending")
 async def get_trending():
@@ -588,22 +717,42 @@ async def get_trending():
 # ===== Providers Management Endpoints =====
 @app.get("/api/providers")
 async def get_providers():
-    """Get all providers - REAL DATA from config + HF Models as providers"""
+    """Get all providers from providers_config_extended.json + HF Models + auto-discovery status"""
     config = load_providers_config()
     providers = config.get("providers", {})
     
+    # Load auto-discovery report to merge status
+    discovery_report = load_auto_discovery_report()
+    discovery_results = {}
+    if discovery_report and "http_providers" in discovery_report:
+        for result in discovery_report["http_providers"].get("results", []):
+            discovery_results[result.get("provider_id")] = result
+    
     result = []
     for provider_id, provider_data in providers.items():
-        result.append({
-            "provider_id": provider_id,
+        # Merge with auto-discovery data if available
+        discovery_data = discovery_results.get(provider_id, {})
+        
+        provider_entry = {
+            "id": provider_id,
+            "provider_id": provider_id,  # Keep for backward compatibility
             "name": provider_data.get("name", provider_id),
             "category": provider_data.get("category", "unknown"),
-            "type": provider_data.get("type", "unknown"),
-            "status": "validated" if provider_data.get("validated") else "unvalidated",
+            "base_url": provider_data.get("base_url", ""),
+            "type": provider_data.get("type", "http"),
+            "priority": provider_data.get("priority", 0),
+            "weight": provider_data.get("weight", 0),
+            "requires_auth": provider_data.get("requires_auth", False),
+            "rate_limit": provider_data.get("rate_limit", {}),
+            "endpoints": provider_data.get("endpoints", {}),
+            "status": discovery_data.get("status", "UNKNOWN") if discovery_data else "unvalidated",
             "validated_at": provider_data.get("validated_at"),
-            "response_time_ms": provider_data.get("response_time_ms"),
+            "response_time_ms": discovery_data.get("response_time_ms") or provider_data.get("response_time_ms"),
+            "error_reason": discovery_data.get("error_reason"),
+            "test_endpoint": discovery_data.get("test_endpoint"),
             "added_by": provider_data.get("added_by", "manual")
-        })
+        }
+        result.append(provider_entry)
     
     # Add HF Models as providers
     try:
@@ -611,6 +760,7 @@ async def get_providers():
         for model_key, spec in MODEL_SPECS.items():
             is_loaded = model_key in _registry._pipelines
             result.append({
+                "id": f"hf_model_{model_key}",
                 "provider_id": f"hf_model_{model_key}",
                 "name": f"HF Model: {spec.model_id}",
                 "category": spec.category,
@@ -624,12 +774,12 @@ async def get_providers():
                 "added_by": "hf_models"
             })
     except Exception as e:
-        print(f"⚠ Could not add HF models as providers: {e}")
+        logger.warning(f"Could not add HF models as providers: {e}")
     
     return {
         "providers": result,
         "total": len(result),
-        "source": "providers_config_extended.json + HF Models (Real Data)"
+        "source": "providers_config_extended.json + HF Models + Auto-Discovery Report"
     }
 
 
@@ -750,9 +900,9 @@ async def run_diagnostics(auto_fix: bool = False):
     if not PROVIDERS_CONFIG_PATH.exists():
         issues.append({"type": "config", "message": "Providers config not found"})
     
-    # Check APL report
-    if not APL_REPORT_PATH.exists():
-        issues.append({"type": "apl", "message": "APL report not found"})
+    # Check auto-discovery report
+    if not AUTO_DISCOVERY_REPORT_PATH.exists():
+        issues.append({"type": "auto_discovery", "message": "Auto-discovery report not found"})
     
     return {
         "status": "completed",
@@ -810,43 +960,72 @@ async def run_apl_scan():
 
 @app.get("/api/apl/report")
 async def get_apl_report():
-    """Get APL validation report"""
-    report = load_apl_report()
+    """Get APL validation report (alias for auto-discovery report)"""
+    return await get_providers_auto_discovery_report()
+
+@app.get("/api/providers/auto-discovery-report")
+async def get_providers_auto_discovery_report():
+    """Get PROVIDER_AUTO_DISCOVERY_REPORT.json"""
+    report = load_auto_discovery_report()
     
     if not report:
         return {
-            "status": "not_available",
-            "message": "APL report not found. Run APL scan first."
+            "ok": False,
+            "error": "Auto-discovery report file not found",
+            "message": f"Report file not found at {AUTO_DISCOVERY_REPORT_PATH}"
         }
     
-    return report
-
+    return {
+        "ok": True,
+        "report": report,
+        "source": "PROVIDER_AUTO_DISCOVERY_REPORT.json"
+    }
 
-@app.get("/api/apl/summary")
-async def get_apl_summary():
-    """Get APL summary statistics"""
-    report = load_apl_report()
+@app.get("/api/providers/health-summary")
+async def get_providers_health_summary():
+    """Get simplified health summary from auto-discovery report"""
+    report = load_auto_discovery_report()
     
     if not report or "stats" not in report:
         return {
-            "status": "not_available",
-            "message": "APL report not found"
+            "ok": False,
+            "error": "Auto-discovery report not found or invalid",
+            "message": f"Report file not found at {AUTO_DISCOVERY_REPORT_PATH}"
         }
     
     stats = report.get("stats", {})
+    http_providers = report.get("http_providers", {})
+    hf_providers = report.get("hf_providers", {})
+    
+    # Count by status
+    status_counts = {"VALID": 0, "INVALID": 0, "CONDITIONALLY_AVAILABLE": 0}
+    for result in http_providers.get("results", []):
+        status = result.get("status", "UNKNOWN")
+        if status in status_counts:
+            status_counts[status] += 1
+    
     return {
-        "http_candidates": stats.get("total_http_candidates", 0),
-        "http_valid": stats.get("http_valid", 0),
-        "http_invalid": stats.get("http_invalid", 0),
-        "http_conditional": stats.get("http_conditional", 0),
-        "hf_candidates": stats.get("total_hf_candidates", 0),
-        "hf_valid": stats.get("hf_valid", 0),
-        "hf_invalid": stats.get("hf_invalid", 0),
-        "hf_conditional": stats.get("hf_conditional", 0),
-        "total_active": stats.get("total_active_providers", 0),
-        "timestamp": stats.get("timestamp", "")
+        "ok": True,
+        "summary": {
+            "total_active_providers": stats.get("total_active_providers", 0),
+            "http_valid": stats.get("http_valid", 0),
+            "http_invalid": stats.get("http_invalid", 0),
+            "http_conditional": stats.get("http_conditional", 0),
+            "hf_valid": stats.get("hf_valid", 0),
+            "hf_invalid": stats.get("hf_invalid", 0),
+            "hf_conditional": stats.get("hf_conditional", 0),
+            "status_breakdown": status_counts,
+            "execution_time_sec": stats.get("execution_time_sec", 0),
+            "timestamp": stats.get("timestamp", "")
+        },
+        "source": "PROVIDER_AUTO_DISCOVERY_REPORT.json"
     }
 
+@app.get("/api/apl/summary")
+async def get_apl_summary():
+    """Get APL summary statistics (alias for health-summary)"""
+    return await get_providers_health_summary()
+
 
 # ===== HF Models Endpoints =====
 @app.get("/api/hf/models")

static/js/app.js

@@ -46,15 +46,40 @@ function initTabs() {
     });
 }
 
-// Load tab-specific data
+// Load tab-specific data - synchronized with HTML tabs
 function loadTabData(tabId) {
     switch(tabId) {
         case 'dashboard':
-            loadDashboard();
-            break;
         case 'market':
             loadMarketData();
             break;
+        case 'monitor':
+            loadMonitorData();
+            break;
+        case 'advanced':
+            loadAdvancedData();
+            break;
+        case 'admin':
+            loadAdminData();
+            break;
+        case 'hf':
+            loadHFHealth();
+            loadModels();
+            break;
+        case 'pools':
+            loadPools();
+            break;
+        case 'logs':
+            loadLogs();
+            break;
+        case 'resources':
+            loadResources();
+            loadAPIRegistry();
+            break;
+        case 'reports':
+            loadReports();
+            break;
+        // Legacy tab names for backward compatibility
         case 'models':
             loadModels();
             break;
@@ -72,7 +97,6 @@ function loadTabData(tabId) {
             loadDiagnostics();
             break;
         case 'api-explorer':
-            // Load available endpoints
             loadAPIEndpoints();
             break;
     }
@@ -925,72 +949,123 @@ async function loadNews() {
 // Load Providers
 async function loadProviders() {
     try {
-        const response = await fetch('/api/providers');
-        const data = await response.json();
+        // Load providers and auto-discovery health summary in parallel
+        const [providersRes, healthRes] = await Promise.all([
+            fetch('/api/providers'),
+            fetch('/api/providers/health-summary').catch(() => null) // Optional
+        ]);
         
-        const providers = data.providers || data || [];
+        const providersData = await providersRes.json();
+        const providers = providersData.providers || providersData || [];
         
-        if (providers.length > 0) {
-            const providersDiv = document.getElementById('providers-list');
-            providersDiv.innerHTML = `
-                <div style="overflow-x: auto;">
-                    <table>
-                        <thead>
-                            <tr>
-                                <th>ID</th>
-                                <th>نام</th>
-                                <th>دسته</th>
-                                <th>نوع</th>
-                                <th>وضعیت</th>
-                                <th>جزئیات</th>
-                            </tr>
-                        </thead>
-                        <tbody>
-                            ${providers.map(provider => {
-                                const status = provider.status || 'unknown';
-                                const statusConfig = {
-                                    'validated': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ معتبر' },
-                                    'available': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ در دسترس' },
-                                    'online': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ آنلاین' },
-                                    'unvalidated': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ نامعتبر' },
-                                    'not_loaded': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ بارگذاری نشده' },
-                                    'offline': { color: 'var(--danger)', bg: 'rgba(239, 68, 68, 0.2)', text: '❌ آفلاین' },
-                                    'degraded': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ تخریب شده' }
-                                };
-                                const statusInfo = statusConfig[status] || { color: 'var(--text-secondary)', bg: 'rgba(156, 163, 175, 0.2)', text: '❓ نامشخص' };
-                                
-                                return `
-                                    <tr>
-                                        <td>${provider.provider_id || provider.id || '-'}</td>
-                                        <td><strong>${provider.name || 'Unknown'}</strong></td>
-                                        <td>${provider.category || '-'}</td>
-                                        <td>${provider.type || '-'}</td>
-                                        <td>
-                                            <span style="padding: 5px 10px; border-radius: 5px; background: ${statusInfo.bg}; color: ${statusInfo.color}; font-size: 12px;">
-                                                ${statusInfo.text}
-                                            </span>
-                                        </td>
-                                        <td>
-                                            ${provider.response_time_ms ? `<span style="font-size: 12px; color: var(--text-secondary);">${provider.response_time_ms}ms</span>` : ''}
-                                            ${provider.endpoint ? `<a href="${provider.endpoint}" target="_blank" style="color: var(--primary); font-size: 12px;">🔗</a>` : ''}
-                                        </td>
-                                    </tr>
-                                `;
-                            }).join('')}
-                        </tbody>
-                    </table>
-                </div>
-                <div style="margin-top: 15px; padding: 15px; background: rgba(102, 126, 234, 0.1); border-radius: 10px;">
-                    <strong>کل Providerها:</strong> ${data.total || providers.length}
-                </div>
-            `;
-        } else {
-            document.getElementById('providers-list').innerHTML = '<div class="alert alert-warning">هیچ Providerی یافت نشد</div>';
+        // Update providers list
+        const providersDiv = document.getElementById('providers-list');
+        if (providersDiv) {
+            if (providers.length > 0) {
+                providersDiv.innerHTML = `
+                    <div style="overflow-x: auto;">
+                        <table>
+                            <thead>
+                                <tr>
+                                    <th>ID</th>
+                                    <th>نام</th>
+                                    <th>دسته</th>
+                                    <th>نوع</th>
+                                    <th>وضعیت</th>
+                                    <th>جزئیات</th>
+                                </tr>
+                            </thead>
+                            <tbody>
+                                ${providers.map(provider => {
+                                    const status = provider.status || 'unknown';
+                                    const statusConfig = {
+                                        'VALID': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ معتبر' },
+                                        'validated': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ معتبر' },
+                                        'available': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ در دسترس' },
+                                        'online': { color: 'var(--success)', bg: 'rgba(16, 185, 129, 0.2)', text: '✅ آنلاین' },
+                                        'CONDITIONALLY_AVAILABLE': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ شرطی' },
+                                        'INVALID': { color: 'var(--danger)', bg: 'rgba(239, 68, 68, 0.2)', text: '❌ نامعتبر' },
+                                        'unvalidated': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ نامعتبر' },
+                                        'not_loaded': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ بارگذاری نشده' },
+                                        'offline': { color: 'var(--danger)', bg: 'rgba(239, 68, 68, 0.2)', text: '❌ آفلاین' },
+                                        'degraded': { color: 'var(--warning)', bg: 'rgba(245, 158, 11, 0.2)', text: '⚠️ تخریب شده' }
+                                    };
+                                    const statusInfo = statusConfig[status] || { color: 'var(--text-secondary)', bg: 'rgba(156, 163, 175, 0.2)', text: '❓ نامشخص' };
+                                    
+                                    return `
+                                        <tr>
+                                            <td>${provider.provider_id || provider.id || '-'}</td>
+                                            <td><strong>${provider.name || 'Unknown'}</strong></td>
+                                            <td>${provider.category || '-'}</td>
+                                            <td>${provider.type || '-'}</td>
+                                            <td>
+                                                <span style="padding: 5px 10px; border-radius: 5px; background: ${statusInfo.bg}; color: ${statusInfo.color}; font-size: 12px;">
+                                                    ${statusInfo.text}
+                                                </span>
+                                            </td>
+                                            <td>
+                                                ${provider.response_time_ms ? `<span style="font-size: 12px; color: var(--text-secondary);">${provider.response_time_ms}ms</span>` : ''}
+                                                ${provider.endpoint ? `<a href="${provider.endpoint}" target="_blank" style="color: var(--primary); font-size: 12px;">🔗</a>` : ''}
+                                                ${provider.error_reason ? `<span style="font-size: 11px; color: var(--danger);" title="${provider.error_reason}">⚠️</span>` : ''}
+                                            </td>
+                                        </tr>
+                                    `;
+                                }).join('')}
+                            </tbody>
+                        </table>
+                    </div>
+                    <div style="margin-top: 15px; padding: 15px; background: rgba(102, 126, 234, 0.1); border-radius: 10px;">
+                        <strong>کل Providerها:</strong> ${providersData.total || providers.length}
+                    </div>
+                `;
+            } else {
+                providersDiv.innerHTML = '<div class="alert alert-warning">هیچ Providerی یافت نشد</div>';
+            }
+        }
+        
+        // Update health summary if available
+        if (healthRes) {
+            try {
+                const healthData = await healthRes.json();
+                const healthSummaryDiv = document.getElementById('providers-health-summary');
+                if (healthSummaryDiv && healthData.ok && healthData.summary) {
+                    const summary = healthData.summary;
+                    healthSummaryDiv.innerHTML = `
+                        <div class="card">
+                            <h3>Provider Health Summary</h3>
+                            <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(200px, 1fr)); gap: 15px; margin-top: 15px;">
+                                <div style="padding: 15px; background: rgba(16, 185, 129, 0.1); border-radius: 10px; border-left: 4px solid var(--success);">
+                                    <div style="font-size: 24px; font-weight: bold; color: var(--success);">${summary.total_active_providers || 0}</div>
+                                    <div style="font-size: 12px; color: var(--text-secondary);">Total Active</div>
+                                </div>
+                                <div style="padding: 15px; background: rgba(16, 185, 129, 0.1); border-radius: 10px; border-left: 4px solid var(--success);">
+                                    <div style="font-size: 24px; font-weight: bold; color: var(--success);">${summary.http_valid || 0}</div>
+                                    <div style="font-size: 12px; color: var(--text-secondary);">HTTP Valid</div>
+                                </div>
+                                <div style="padding: 15px; background: rgba(239, 68, 68, 0.1); border-radius: 10px; border-left: 4px solid var(--danger);">
+                                    <div style="font-size: 24px; font-weight: bold; color: var(--danger);">${summary.http_invalid || 0}</div>
+                                    <div style="font-size: 12px; color: var(--text-secondary);">HTTP Invalid</div>
+                                </div>
+                                <div style="padding: 15px; background: rgba(245, 158, 11, 0.1); border-radius: 10px; border-left: 4px solid var(--warning);">
+                                    <div style="font-size: 24px; font-weight: bold; color: var(--warning);">${summary.http_conditional || 0}</div>
+                                    <div style="font-size: 12px; color: var(--text-secondary);">Conditional</div>
+                                </div>
+                            </div>
+                        </div>
+                    `;
+                }
+            } catch (e) {
+                console.warn('Could not load health summary:', e);
+            }
         }
+        
     } catch (error) {
         console.error('Error loading providers:', error);
         showError('خطا در بارگذاری Providerها');
-        document.getElementById('providers-list').innerHTML = '<div class="alert alert-error">خطا در بارگذاری Providerها</div>';
+        const providersDiv = document.getElementById('providers-list');
+        if (providersDiv) {
+            providersDiv.innerHTML = '<div class="alert alert-error">خطا در بارگذاری Providerها</div>';
+        }
     }
 }
 
@@ -1279,3 +1354,199 @@ function showSuccess(message) {
     setTimeout(() => alert.remove(), 5000);
 }
 
+// Additional tab loaders for HTML tabs
+async function loadMonitorData() {
+    // Load API monitor data
+    try {
+        const response = await fetch('/api/status');
+        const data = await response.json();
+        const monitorContainer = document.getElementById('monitor-content');
+        if (monitorContainer) {
+            monitorContainer.innerHTML = `
+                <div class="card">
+                    <h3>API Status</h3>
+                    <pre>${JSON.stringify(data, null, 2)}</pre>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading monitor data:', error);
+    }
+}
+
+async function loadAdvancedData() {
+    // Load advanced/API explorer data
+    loadAPIEndpoints();
+    loadDiagnostics();
+}
+
+async function loadAdminData() {
+    // Load admin panel data
+    try {
+        const [providersRes, modelsRes] = await Promise.all([
+            fetch('/api/providers'),
+            fetch('/api/models/status')
+        ]);
+        const providers = await providersRes.json();
+        const models = await modelsRes.json();
+        
+        const adminContainer = document.getElementById('admin-content');
+        if (adminContainer) {
+            adminContainer.innerHTML = `
+                <div class="card">
+                    <h3>System Status</h3>
+                    <p>Providers: ${providers.total || 0}</p>
+                    <p>Models: ${models.models_loaded || 0} loaded</p>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading admin data:', error);
+    }
+}
+
+async function loadHFHealth() {
+    // Load HF models health status
+    try {
+        const response = await fetch('/api/models/status');
+        const data = await response.json();
+        const hfContainer = document.getElementById('hf-status');
+        if (hfContainer) {
+            hfContainer.innerHTML = `
+                <div class="card">
+                    <h3>HF Models Status</h3>
+                    <p>Mode: ${data.hf_mode || 'unknown'}</p>
+                    <p>Loaded: ${data.models_loaded || 0}</p>
+                    <p>Failed: ${data.failed_count || 0}</p>
+                    <p>Status: ${data.status || 'unknown'}</p>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading HF health:', error);
+    }
+}
+
+async function loadPools() {
+    // Load provider pools
+    try {
+        const response = await fetch('/api/pools');
+        const data = await response.json();
+        const poolsContainer = document.getElementById('pools-content');
+        if (poolsContainer) {
+            poolsContainer.innerHTML = `
+                <div class="card">
+                    <h3>Provider Pools</h3>
+                    <p>${data.message || 'No pools available'}</p>
+                    <pre>${JSON.stringify(data, null, 2)}</pre>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading pools:', error);
+    }
+}
+
+async function loadLogs() {
+    // Load recent logs
+    try {
+        const response = await fetch('/api/logs/recent');
+        const data = await response.json();
+        const logsContainer = document.getElementById('logs-content');
+        if (logsContainer) {
+            const logsHtml = data.logs && data.logs.length > 0
+                ? data.logs.map(log => `<div class="log-entry">${JSON.stringify(log)}</div>`).join('')
+                : '<p>No logs available</p>';
+            logsContainer.innerHTML = `<div class="card"><h3>Recent Logs</h3>${logsHtml}</div>`;
+        }
+    } catch (error) {
+        console.error('Error loading logs:', error);
+    }
+}
+
+async function loadReports() {
+    // Load reports/analytics
+    try {
+        const response = await fetch('/api/providers/health-summary');
+        const data = await response.json();
+        const reportsContainer = document.getElementById('reports-content');
+        if (reportsContainer) {
+            reportsContainer.innerHTML = `
+                <div class="card">
+                    <h3>Provider Health Report</h3>
+                    <pre>${JSON.stringify(data, null, 2)}</pre>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading reports:', error);
+    }
+}
+
+async function loadResources() {
+    // Load resources summary
+    try {
+        const response = await fetch('/api/resources');
+        const data = await response.json();
+        const resourcesContainer = document.getElementById('resources-summary');
+        if (resourcesContainer) {
+            const summary = data.summary || {};
+            resourcesContainer.innerHTML = `
+                <div class="card">
+                    <h3>Resources Summary</h3>
+                    <p>Total: ${summary.total_resources || 0}</p>
+                    <p>Free: ${summary.free_resources || 0}</p>
+                    <p>Models: ${summary.models_available || 0}</p>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading resources:', error);
+    }
+}
+
+async function loadAPIRegistry() {
+    // Load API registry from all_apis_merged_2025.json
+    try {
+        const response = await fetch('/api/resources/apis');
+        const data = await response.json();
+        
+        if (!data.ok) {
+            console.warn('API registry not available:', data.error);
+            return;
+        }
+        
+        const registryContainer = document.getElementById('api-registry-section');
+        if (registryContainer) {
+            const metadata = data.metadata || {};
+            const categories = data.categories || [];
+            
+            registryContainer.innerHTML = `
+                <div class="card">
+                    <h3>API Registry: ${metadata.name || 'Unknown'}</h3>
+                    <p>Version: ${metadata.version || 'N/A'}</p>
+                    <p>Description: ${metadata.description || 'N/A'}</p>
+                    <h4>Categories:</h4>
+                    <ul>
+                        ${categories.map(cat => `<li>${cat}</li>`).join('')}
+                    </ul>
+                    <p>Total Files: ${data.total_raw_files || 0}</p>
+                </div>
+            `;
+        }
+        
+        // Also update metadata container if it exists
+        const metadataContainer = document.getElementById('api-registry-metadata');
+        if (metadataContainer) {
+            metadataContainer.innerHTML = `
+                <div class="card">
+                    <h4>Metadata</h4>
+                    <pre>${JSON.stringify(metadata, null, 2)}</pre>
+                </div>
+            `;
+        }
+    } catch (error) {
+        console.error('Error loading API registry:', error);
+    }
+}
+