Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
d4371ba
ci: harden doctor step PATH to include /usr/local/bin:/usr/bin:/bin; …
d-ulker Aug 9, 2025
422b0f6
ci: fix doctor step Python invocation via heredoc script to avoid quo…
d-ulker Aug 9, 2025
c8516b0
ci: retrigger doctor-only after fix
d-ulker Aug 9, 2025
cf0aa3f
ci: remove tee from doctor; use redirections for env/conda logs
d-ulker Aug 9, 2025
66b0a97
ci: remove redundant PATH exports in doctor steps; rely on executor PATH
d-ulker Aug 9, 2025
8d017b1
ci: fix downloader error message; no duplicated PATH export; verify n…
d-ulker Aug 9, 2025
5757d96
ci: replace heredoc with printf in doctor step to avoid '<<' tag pars…
d-ulker Aug 9, 2025
fdbf605
ci: make doctor pwd and ls non-fatal (|| true)
d-ulker Aug 9, 2025
1a0a2ad
ci: mitigate coverage db crashes: clear .coverage*, reduce xdist to -…
d-ulker Aug 9, 2025
7f806e9
ci: isolate coverage from xdist; run tests in parallel without covera…
d-ulker Aug 9, 2025
b41b449
ci: override pytest addopts for parallel and serial runs to disable g…
d-ulker Aug 9, 2025
775b524
ci: fix unit test env; add Flask to env; set DB env vars; isolate san…
d-ulker Aug 9, 2025
514f8f5
ci: set DB_NAME and HF offline; exclude admin/db tests from parallel;…
d-ulker Aug 9, 2025
0847288
ci: make pre_warm_models offline-aware (skip when HF_HUB_OFFLINE/TRAN…
d-ulker Aug 9, 2025
917652a
ci: make conda env creation resilient to conda-forge 403; fallback to…
d-ulker Aug 9, 2025
5c31b8a
ci: set offline + DB env at executor level; source in conda_exec to …
d-ulker Aug 9, 2025
e1823b0
tests: patch forward_pass to mock AutoConfig to avoid HF network; ci:…
d-ulker Aug 9, 2025
c1e34d1
chore(ci): wrap offline check to satisfy line length; ignore editor l…
d-ulker Aug 9, 2025
7e62911
Fix CI pipeline report counting bug
cursoragent Aug 9, 2025
9eca726
Fix CI pipeline dependency issues and add missing package checks
cursoragent Aug 9, 2025
cdf2620
Refactor: Address code review feedback on CI pipeline
cursoragent Aug 9, 2025
51a7d95
Fix CI pipeline dependency issues and add comprehensive logging
cursoragent Aug 9, 2025
1192d17
Debug CI pipeline issues
deepsource-autofix[bot] Aug 9, 2025
dc887cf
fix: remove unused variables in CI pipeline main function
cursoragent Aug 9, 2025
60cbd9d
Merge pull request #49 from uelkerd/cursor/debug-ci-pipeline-issues-c94f
d-ulker Aug 9, 2025
6abf521
ci: raise coverage threshold to 45% and harden CircleCI (checksum for…
d-ulker Aug 9, 2025
7666057
ci: raise coverage gate to 50% (pyproject, CircleCI)
d-ulker Aug 9, 2025
0c71490
ci: fix Miniconda checksum fetch by resolving final versioned URL bef…
d-ulker Aug 9, 2025
ae54b1d
ci: switch to Miniforge installer and stable .sha256 verification to …
d-ulker Aug 9, 2025
f97141d
ci: fix checksum fetch for Miniforge by using release sha256sum.txt a…
d-ulker Aug 9, 2025
0e7be5b
ci: robust Miniforge checksum resolution via GitHub releases API (ext…
d-ulker Aug 9, 2025
c30a3ee
ci: avoid curl pipewrite errors by storing GitHub releases API respon…
d-ulker Aug 9, 2025
389794a
ci: pin fallback tools; fix PATH; add .coveragerc; rm coverage.xml
d-ulker Aug 9, 2025
b2ece97
ci: harden doctor step PATH to include /usr/local/bin:/usr/bin:/bin; …
deepsource-autofix[bot] Aug 10, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
218 changes: 155 additions & 63 deletions .circleci/config.yml

Large diffs are not rendered by default.

Binary file modified .coverage
Binary file not shown.
23 changes: 23 additions & 0 deletions .coveragerc
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
[run]
relative_files = True
parallel = True
omit =
*/site-packages/*
*/tests/*
*/.venv/*
*/venv/*
*/.tox/*

[paths]
source =
src
*/workspace/*/src
*/project/*/src
*/Users/*/Projects/SAMO--GENERAL/SAMO--DL/src

[report]
show_missing = True
skip_covered = True
exclude_lines =
pragma: no cover
if __name__ == "__main__":
184 changes: 184 additions & 0 deletions ci_pipeline.log
Original file line number Diff line number Diff line change
Expand Up @@ -2076,3 +2076,187 @@ ERROR:__main__:💥 Some Whisper transcription tests failed!
2025-08-06 10:16:29,574 - INFO - 📊 Generating CI Report
2025-08-06 10:16:29,574 - INFO - ============================================================
2025-08-06 10:16:29,575 - INFO - 🎉 CI Pipeline completed successfully!
2025-08-09 22:42:37,553 - INFO - 🚀 Starting Comprehensive CI Pipeline
2025-08-09 22:42:37,553 - INFO - ============================================================
2025-08-09 22:42:37,553 - INFO - 🔍 Detecting environment...
2025-08-09 22:42:37,554 - WARNING - ⚠️ PyTorch not available for GPU detection
2025-08-09 22:42:37,554 - INFO - 💻 Running in local environment
2025-08-09 22:42:37,554 - INFO - 📊 Environment: {'platform': 'linux', 'python_version': '3.13.3 (main, Apr 8 2025, 19:55:40) [GCC 14.2.0]', 'is_colab': False, 'gpu_available': False, 'conda_env': 'unknown'}
2025-08-09 22:42:37,554 - INFO - 📦 Validating dependencies...
2025-08-09 22:42:37,554 - ERROR - ❌ torch missing
2025-08-09 22:42:37,554 - ERROR - ❌ transformers missing
2025-08-09 22:42:37,554 - ERROR - ❌ fastapi missing
2025-08-09 22:42:37,554 - ERROR - ❌ pydantic missing
2025-08-09 22:42:37,554 - ERROR - ❌ datasets missing
2025-08-09 22:42:37,554 - ERROR - ❌ tokenizers missing
2025-08-09 22:42:37,554 - ERROR - ❌ numpy missing
2025-08-09 22:42:37,554 - ERROR - ❌ pandas missing
2025-08-09 22:42:37,554 - ERROR - ❌ Missing packages: ['torch', 'transformers', 'fastapi', 'pydantic', 'datasets', 'tokenizers', 'numpy', 'pandas']
2025-08-09 22:42:37,554 - INFO - 🚀 Running scripts/ci/api_health_check.py...
2025-08-09 22:42:37,602 - ERROR - ❌ scripts/ci/api_health_check.py FAILED
2025-08-09 22:42:37,602 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/api_health_check.py", line 18, in <module>
from pydantic import BaseModel, ValidationError, Field
ModuleNotFoundError: No module named 'pydantic'

2025-08-09 22:42:37,602 - ERROR - ❌ api_health_check failed, but continuing...
2025-08-09 22:42:37,602 - INFO - 🚀 Running scripts/ci/bert_model_test.py...
2025-08-09 22:42:37,628 - ERROR - ❌ scripts/ci/bert_model_test.py FAILED
2025-08-09 22:42:37,628 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/bert_model_test.py", line 11, in <module>
import torch
ModuleNotFoundError: No module named 'torch'

2025-08-09 22:42:37,628 - ERROR - ❌ bert_model_test failed, but continuing...
2025-08-09 22:42:37,628 - INFO - 🚀 Running scripts/ci/t5_summarization_test.py...
2025-08-09 22:42:37,657 - ERROR - ❌ scripts/ci/t5_summarization_test.py FAILED
2025-08-09 22:42:37,657 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/t5_summarization_test.py", line 18, in <module>
from models.summarization.t5_summarizer import create_t5_summarizer
File "/workspace/src/models/summarization/__init__.py", line 19, in <module>
from .dataset_loader import SummarizationDataset, create_summarization_loader
File "/workspace/src/models/summarization/dataset_loader.py", line 2, in <module>
from torch.utils.data import Dataset
ModuleNotFoundError: No module named 'torch'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/workspace/scripts/ci/t5_summarization_test.py", line 21, in <module>
from src.models.summarization.t5_summarizer import create_t5_summarizer
ModuleNotFoundError: No module named 'src'

2025-08-09 22:42:37,657 - ERROR - ❌ t5_summarization_test failed, but continuing...
2025-08-09 22:42:37,657 - INFO - 🚀 Running scripts/ci/whisper_transcription_test.py...
2025-08-09 22:42:37,680 - ERROR - ❌ scripts/ci/whisper_transcription_test.py FAILED
2025-08-09 22:42:37,680 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/whisper_transcription_test.py", line 11, in <module>
import numpy as np
ModuleNotFoundError: No module named 'numpy'

2025-08-09 22:42:37,680 - ERROR - ❌ whisper_transcription_test failed, but continuing...
2025-08-09 22:42:37,680 - INFO - 🚀 Running scripts/ci/model_calibration_test.py...
2025-08-09 22:42:37,707 - ERROR - ❌ scripts/ci/model_calibration_test.py FAILED
2025-08-09 22:42:37,708 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/model_calibration_test.py", line 18, in <module>
import torch
ModuleNotFoundError: No module named 'torch'

2025-08-09 22:42:37,708 - ERROR - ❌ model_calibration_test failed, but continuing...
2025-08-09 22:42:37,708 - INFO - 🚀 Running scripts/ci/onnx_conversion_test.py...
2025-08-09 22:42:37,730 - ERROR - ❌ scripts/ci/onnx_conversion_test.py FAILED
2025-08-09 22:42:37,730 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/onnx_conversion_test.py", line 10, in <module>
import numpy as np
ModuleNotFoundError: No module named 'numpy'

2025-08-09 22:42:37,730 - ERROR - ❌ onnx_conversion_test failed, but continuing...
2025-08-09 22:42:37,730 - INFO - 🧪 Running unit tests...
2025-08-09 22:42:37,740 - ERROR - ❌ Unit tests FAILED
2025-08-09 22:42:37,740 - ERROR - Return code: 1
2025-08-09 22:42:37,740 - ERROR - Error output: /usr/bin/python3: No module named pytest

2025-08-09 22:42:37,740 - ERROR - Standard output:
2025-08-09 22:42:37,740 - INFO - 🎯 Running E2E tests...
2025-08-09 22:42:37,749 - ERROR - ❌ E2E tests FAILED
2025-08-09 22:42:37,749 - ERROR - Error output: /usr/bin/python3: No module named pytest

2025-08-09 22:42:37,749 - INFO - 🖥️ Testing GPU compatibility...
2025-08-09 22:42:37,749 - ERROR - ❌ GPU compatibility test failed: No module named 'torch'
2025-08-09 22:42:37,749 - INFO - ⚡ Running performance benchmarks...
2025-08-09 22:42:37,749 - ERROR - ❌ Performance benchmark failed: No module named 'torch'
2025-08-09 22:42:37,749 - INFO - 📊 Generating CI Report
2025-08-09 22:42:37,749 - INFO - ============================================================
2025-08-09 22:42:37,749 - ERROR - ❌ CI Pipeline failed!
2025-08-09 22:47:39,247 - INFO - 🚀 Starting Comprehensive CI Pipeline
2025-08-09 22:47:39,247 - INFO - ============================================================
2025-08-09 22:47:39,247 - INFO - 🔍 Detecting environment...
2025-08-09 22:47:39,248 - WARNING - ⚠️ PyTorch not available for GPU detection
2025-08-09 22:47:39,248 - INFO - 💻 Running in local environment
2025-08-09 22:47:39,248 - INFO - 📊 Environment: {'platform': 'linux', 'python_version': '3.13.3 (main, Apr 8 2025, 19:55:40) [GCC 14.2.0]', 'is_colab': False, 'gpu_available': False, 'conda_env': 'unknown'}
2025-08-09 22:47:39,248 - INFO - 📦 Validating dependencies...
2025-08-09 22:47:39,248 - ERROR - ❌ torch missing
2025-08-09 22:47:39,248 - ERROR - ❌ transformers missing
2025-08-09 22:47:39,248 - ERROR - ❌ fastapi missing
2025-08-09 22:47:39,248 - ERROR - ❌ pydantic missing
2025-08-09 22:47:39,248 - ERROR - ❌ datasets missing
2025-08-09 22:47:39,248 - ERROR - ❌ tokenizers missing
2025-08-09 22:47:39,248 - ERROR - ❌ numpy missing
2025-08-09 22:47:39,248 - ERROR - ❌ pandas missing
2025-08-09 22:47:39,248 - ERROR - ❌ Missing packages: ['torch', 'transformers', 'fastapi', 'pydantic', 'datasets', 'tokenizers', 'numpy', 'pandas']
2025-08-09 22:47:39,248 - INFO - 🚀 Running scripts/ci/api_health_check.py...
2025-08-09 22:47:39,286 - ERROR - ❌ scripts/ci/api_health_check.py FAILED
2025-08-09 22:47:39,286 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/api_health_check.py", line 18, in <module>
from pydantic import BaseModel, ValidationError, Field
ModuleNotFoundError: No module named 'pydantic'

2025-08-09 22:47:39,286 - ERROR - ❌ api_health_check failed, but continuing...
2025-08-09 22:47:39,286 - INFO - 🚀 Running scripts/ci/bert_model_test.py...
2025-08-09 22:47:39,309 - ERROR - ❌ scripts/ci/bert_model_test.py FAILED
2025-08-09 22:47:39,309 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/bert_model_test.py", line 11, in <module>
import torch
ModuleNotFoundError: No module named 'torch'

2025-08-09 22:47:39,309 - ERROR - ❌ bert_model_test failed, but continuing...
2025-08-09 22:47:39,309 - INFO - 🚀 Running scripts/ci/t5_summarization_test.py...
2025-08-09 22:47:39,343 - ERROR - ❌ scripts/ci/t5_summarization_test.py FAILED
2025-08-09 22:47:39,343 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/t5_summarization_test.py", line 18, in <module>
from models.summarization.t5_summarizer import create_t5_summarizer
File "/workspace/src/models/summarization/__init__.py", line 19, in <module>
from .dataset_loader import SummarizationDataset, create_summarization_loader
File "/workspace/src/models/summarization/dataset_loader.py", line 2, in <module>
from torch.utils.data import Dataset
ModuleNotFoundError: No module named 'torch'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/workspace/scripts/ci/t5_summarization_test.py", line 21, in <module>
from src.models.summarization.t5_summarizer import create_t5_summarizer
ModuleNotFoundError: No module named 'src'

2025-08-09 22:47:39,343 - ERROR - ❌ t5_summarization_test failed, but continuing...
2025-08-09 22:47:39,343 - INFO - 🚀 Running scripts/ci/whisper_transcription_test.py...
2025-08-09 22:47:39,365 - ERROR - ❌ scripts/ci/whisper_transcription_test.py FAILED
2025-08-09 22:47:39,366 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/whisper_transcription_test.py", line 11, in <module>
import numpy as np
ModuleNotFoundError: No module named 'numpy'

2025-08-09 22:47:39,366 - ERROR - ❌ whisper_transcription_test failed, but continuing...
2025-08-09 22:47:39,366 - INFO - 🚀 Running scripts/ci/model_calibration_test.py...
2025-08-09 22:47:39,392 - ERROR - ❌ scripts/ci/model_calibration_test.py FAILED
2025-08-09 22:47:39,392 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/model_calibration_test.py", line 18, in <module>
import torch
ModuleNotFoundError: No module named 'torch'

2025-08-09 22:47:39,392 - ERROR - ❌ model_calibration_test failed, but continuing...
2025-08-09 22:47:39,392 - INFO - 🚀 Running scripts/ci/onnx_conversion_test.py...
2025-08-09 22:47:39,420 - ERROR - ❌ scripts/ci/onnx_conversion_test.py FAILED
2025-08-09 22:47:39,420 - ERROR - Error output: Traceback (most recent call last):
File "/workspace/scripts/ci/onnx_conversion_test.py", line 10, in <module>
import numpy as np
ModuleNotFoundError: No module named 'numpy'

2025-08-09 22:47:39,420 - ERROR - ❌ onnx_conversion_test failed, but continuing...
2025-08-09 22:47:39,420 - INFO - 🧪 Running unit tests...
2025-08-09 22:47:39,429 - ERROR - ❌ Unit tests FAILED
2025-08-09 22:47:39,429 - ERROR - Return code: 1
2025-08-09 22:47:39,429 - ERROR - Error output: /usr/bin/python3: No module named pytest

2025-08-09 22:47:39,429 - ERROR - Standard output:
2025-08-09 22:47:39,429 - INFO - 🎯 Running E2E tests...
2025-08-09 22:47:39,438 - ERROR - ❌ E2E tests FAILED
2025-08-09 22:47:39,438 - ERROR - Error output: /usr/bin/python3: No module named pytest

2025-08-09 22:47:39,438 - INFO - 🖥️ Testing GPU compatibility...
2025-08-09 22:47:39,438 - ERROR - ❌ GPU compatibility test failed: No module named 'torch'
2025-08-09 22:47:39,438 - INFO - ⚡ Running performance benchmarks...
2025-08-09 22:47:39,438 - ERROR - ❌ Performance benchmark failed: No module named 'torch'
2025-08-09 22:47:39,438 - INFO - 📊 Generating CI Report
2025-08-09 22:47:39,438 - INFO - ============================================================
2025-08-09 22:47:39,438 - ERROR - ❌ CI Pipeline failed!
36 changes: 18 additions & 18 deletions ci_pipeline_report.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,27 +3,27 @@
============================================================

📊 SUMMARY:
- Total Tests: 12
- Passed: 11
- Failed: 1
- Success Rate: 91.7%
- Total Tests: 11
- Passed: 0
- Failed: 11
- Success Rate: 0.0%

🔍 DETAILED RESULTS:
- environment: {'platform': 'darwin', 'python_version': '3.8.6rc1 (v3.8.6rc1:08bd63da6e, Sep 7 2020, 16:14:12) \n[Clang 6.0 (clang-600.0.57)]', 'is_colab': False, 'gpu_available': False, 'conda_env': 'base'}
- dependencies: ✅ PASSED
- api_health_check: ✅ PASSED
- bert_model_test: ✅ PASSED
- t5_summarization_test: ✅ PASSED
- whisper_transcription_test: ✅ PASSED
- model_calibration_test: ✅ PASSED
- onnx_conversion_test: ✅ PASSED
- unit_tests: ✅ PASSED
- e2e_tests: ✅ PASSED
- gpu_compatibility: ✅ PASSED
- performance: ✅ PASSED
- environment: {'platform': 'linux', 'python_version': '3.13.3 (main, Apr 8 2025, 19:55:40) [GCC 14.2.0]', 'is_colab': False, 'gpu_available': False, 'conda_env': 'unknown'}
- dependencies: ❌ FAILED
- api_health_check: ❌ FAILED
- bert_model_test: ❌ FAILED
- t5_summarization_test: ❌ FAILED
- whisper_transcription_test: ❌ FAILED
- model_calibration_test: ❌ FAILED
- onnx_conversion_test: ❌ FAILED
- unit_tests: ❌ FAILED
- e2e_tests: ❌ FAILED
- gpu_compatibility: ❌ FAILED
- performance: ❌ FAILED

⏱️ EXECUTION TIME: 34.5s
⏱️ EXECUTION TIME: 0.2s

🎯 RECOMMENDATIONS:
⚠️ Failed tests:
⚠️ Failed tests: dependencies, api_health_check, bert_model_test, t5_summarization_test, whisper_transcription_test, model_calibration_test, onnx_conversion_test, unit_tests, e2e_tests, gpu_compatibility, performance
🔧 Please fix the failed tests before deployment.
Loading