2026-01-18 08:19:34 +01:00
{
"cells": [
2026-01-18 08:20:24 +01:00
{
"cell_type": "markdown",
"id": "6b547287",
"metadata": {
"tags": [
"papermill-error-cell-tag"
]
},
"source": [
"<span style=\"color:red; font-family:Helvetica Neue, Helvetica, Arial, sans-serif; font-size:2em;\">An Exception was encountered at '<a href=\"#papermill-error-cell\">In [9]</a>'.</span>"
]
},
2026-01-18 08:19:34 +01:00
{
"cell_type": "markdown",
"id": "header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.002021,
"end_time": "2026-01-18T07:14:59.560538",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:14:59.558517",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"# PaddleOCR Hyperparameter Optimization via REST API\n",
"\n",
"This notebook runs Ray Tune hyperparameter search calling the PaddleOCR REST API (Docker container).\n",
"\n",
"**Benefits:**\n",
"- No model reload per trial - Model stays loaded in Docker container\n",
"- Faster trials - Skip ~10s model load time per trial\n",
"- Cleaner code - REST API replaces subprocess + CLI arg parsing"
]
},
{
"cell_type": "markdown",
"id": "prereq",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.000882,
"end_time": "2026-01-18T07:14:59.562561",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:14:59.561679",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## Prerequisites\n",
"\n",
"Start 2 PaddleOCR workers for parallel hyperparameter tuning:\n",
"\n",
"```bash\n",
"cd src/paddle_ocr\n",
"docker compose -f docker-compose.workers.yml up\n",
"```\n",
"\n",
"This starts 2 GPU workers on ports 8001-8002, allowing 2 concurrent trials.\n",
"\n",
"For CPU-only systems:\n",
"```bash\n",
"docker compose -f docker-compose.workers.yml --profile cpu up\n",
"```"
]
},
{
"cell_type": "markdown",
"id": "3ob9fsoilc4",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.000859,
"end_time": "2026-01-18T07:14:59.564299",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:14:59.563440",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 0. Dependencies"
]
},
{
"cell_type": "code",
"execution_count": 1,
"id": "wyr2nsoj7",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:14:59.567028Z",
"iopub.status.busy": "2026-01-18T07:14:59.566901Z",
"iopub.status.idle": "2026-01-18T07:15:00.844044Z",
"shell.execute_reply": "2026-01-18T07:15:00.842338Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 1.279907,
"end_time": "2026-01-18T07:15:00.845079",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:14:59.565172",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Requirement already satisfied: ray[tune] in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (2.53.0)\r\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Requirement already satisfied: click>=7.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (8.3.1)\r\n",
"Requirement already satisfied: filelock in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (3.20.3)\r\n",
"Requirement already satisfied: jsonschema in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (4.26.0)\r\n",
"Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (1.1.2)\r\n",
"Requirement already satisfied: packaging>=24.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (25.0)\r\n",
"Requirement already satisfied: protobuf>=3.20.3 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (6.33.4)\r\n",
"Requirement already satisfied: pyyaml in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (6.0.3)\r\n",
"Requirement already satisfied: requests in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (2.32.5)\r\n",
"Requirement already satisfied: pandas in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (2.3.3)\r\n",
"Requirement already satisfied: pydantic!=2.0.*,!=2.1.*,!=2.10.*,!=2.11.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (2.12.5)\r\n",
"Requirement already satisfied: tensorboardX>=1.9 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (2.6.4)\r\n",
"Requirement already satisfied: pyarrow>=9.0.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (22.0.0)\r\n",
"Requirement already satisfied: fsspec in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from ray[tune]) (2026.1.0)\r\n",
"Requirement already satisfied: annotated-types>=0.6.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pydantic!=2.0.*,!=2.1.*,!=2.10.*,!=2.11.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3->ray[tune]) (0.7.0)\r\n",
"Requirement already satisfied: pydantic-core==2.41.5 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pydantic!=2.0.*,!=2.1.*,!=2.10.*,!=2.11.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3->ray[tune]) (2.41.5)\r\n",
"Requirement already satisfied: typing-extensions>=4.14.1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pydantic!=2.0.*,!=2.1.*,!=2.10.*,!=2.11.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3->ray[tune]) (4.15.0)\r\n",
2026-01-18 08:20:24 +01:00
"Requirement already satisfied: typing-inspection>=0.4.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pydantic!=2.0.*,!=2.1.*,!=2.10.*,!=2.11.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,!=2.9.*,<3->ray[tune]) (0.4.2)\r\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"Requirement already satisfied: numpy in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from tensorboardX>=1.9->ray[tune]) (2.4.1)\r\n",
"Requirement already satisfied: attrs>=22.2.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from jsonschema->ray[tune]) (25.4.0)\r\n",
"Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from jsonschema->ray[tune]) (2025.9.1)\r\n",
"Requirement already satisfied: referencing>=0.28.4 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from jsonschema->ray[tune]) (0.37.0)\r\n",
"Requirement already satisfied: rpds-py>=0.25.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from jsonschema->ray[tune]) (0.30.0)\r\n",
2026-01-18 08:19:34 +01:00
"Requirement already satisfied: python-dateutil>=2.8.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas->ray[tune]) (2.9.0.post0)\r\n",
"Requirement already satisfied: pytz>=2020.1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas->ray[tune]) (2025.2)\r\n",
"Requirement already satisfied: tzdata>=2022.7 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas->ray[tune]) (2025.3)\r\n",
"Requirement already satisfied: six>=1.5 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from python-dateutil>=2.8.2->pandas->ray[tune]) (1.17.0)\r\n",
"Requirement already satisfied: charset_normalizer<4,>=2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests->ray[tune]) (3.4.4)\r\n",
"Requirement already satisfied: idna<4,>=2.5 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests->ray[tune]) (3.11)\r\n",
"Requirement already satisfied: urllib3<3,>=1.21.1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests->ray[tune]) (2.6.3)\r\n",
"Requirement already satisfied: certifi>=2017.4.17 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests->ray[tune]) (2026.1.4)\r\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Note: you may need to restart the kernel to use updated packages.\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Requirement already satisfied: optuna in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (4.6.0)\r\n",
"Requirement already satisfied: alembic>=1.5.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (1.18.1)\r\n",
"Requirement already satisfied: colorlog in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (6.10.1)\r\n",
"Requirement already satisfied: numpy in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (2.4.1)\r\n",
"Requirement already satisfied: packaging>=20.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (25.0)\r\n",
"Requirement already satisfied: sqlalchemy>=1.4.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (2.0.45)\r\n",
"Requirement already satisfied: tqdm in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (4.67.1)\r\n",
"Requirement already satisfied: PyYAML in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from optuna) (6.0.3)\r\n",
"Requirement already satisfied: Mako in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from alembic>=1.5.0->optuna) (1.3.10)\r\n",
"Requirement already satisfied: typing-extensions>=4.12 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from alembic>=1.5.0->optuna) (4.15.0)\r\n",
"Requirement already satisfied: greenlet>=1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from sqlalchemy>=1.4.2->optuna) (3.3.0)\r\n",
"Requirement already satisfied: MarkupSafe>=0.9.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from Mako->alembic>=1.5.0->optuna) (3.0.3)\r\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Note: you may need to restart the kernel to use updated packages.\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Requirement already satisfied: requests in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (2.32.5)\r\n",
"Requirement already satisfied: pandas in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (2.3.3)\r\n",
"Requirement already satisfied: charset_normalizer<4,>=2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests) (3.4.4)\r\n",
"Requirement already satisfied: idna<4,>=2.5 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests) (3.11)\r\n",
"Requirement already satisfied: urllib3<3,>=1.21.1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests) (2.6.3)\r\n",
"Requirement already satisfied: certifi>=2017.4.17 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from requests) (2026.1.4)\r\n",
"Requirement already satisfied: numpy>=1.26.0 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas) (2.4.1)\r\n",
"Requirement already satisfied: python-dateutil>=2.8.2 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas) (2.9.0.post0)\r\n",
"Requirement already satisfied: pytz>=2020.1 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas) (2025.2)\r\n",
"Requirement already satisfied: tzdata>=2022.7 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from pandas) (2025.3)\r\n",
"Requirement already satisfied: six>=1.5 in /home/sergio/MastersThesis/.venv/lib/python3.12/site-packages (from python-dateutil>=2.8.2->pandas) (1.17.0)\r\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Note: you may need to restart the kernel to use updated packages.\n"
]
}
],
"source": [
"# Install dependencies (run once)\n",
"%pip install -U \"ray[tune]\"\n",
"%pip install optuna\n",
"%pip install requests pandas"
]
},
{
"cell_type": "markdown",
"id": "imports-header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.009841,
"end_time": "2026-01-18T07:15:00.856488",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:00.846647",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 1. Imports & Setup"
]
},
{
"cell_type": "code",
"execution_count": 2,
"id": "imports",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:00.860270Z",
"iopub.status.busy": "2026-01-18T07:15:00.860041Z",
"iopub.status.idle": "2026-01-18T07:15:01.828333Z",
"shell.execute_reply": "2026-01-18T07:15:01.827627Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.971437,
"end_time": "2026-01-18T07:15:01.829018",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:00.857581",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [],
"source": [
"import os\n",
"from datetime import datetime\n",
"\n",
"import requests\n",
"import pandas as pd\n",
"\n",
"import ray\n",
"from ray import tune, air\n",
"from ray.tune.search.optuna import OptunaSearch"
]
},
{
"cell_type": "markdown",
"id": "config-header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.009553,
"end_time": "2026-01-18T07:15:01.840129",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.830576",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 2. API Configuration"
]
},
{
"cell_type": "code",
"execution_count": 3,
"id": "config",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:01.843415Z",
"iopub.status.busy": "2026-01-18T07:15:01.843179Z",
"iopub.status.idle": "2026-01-18T07:15:01.846155Z",
"shell.execute_reply": "2026-01-18T07:15:01.845706Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.005247,
"end_time": "2026-01-18T07:15:01.846517",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.841270",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [],
"source": [
"# PaddleOCR REST API endpoints - 2 workers for parallel trials\n",
"# Start workers with: cd src/paddle_ocr && docker compose -f docker-compose.workers.yml up\n",
"WORKER_PORTS = [8001, 8002]\n",
"WORKER_URLS = [f\"http://localhost:{port}\" for port in WORKER_PORTS]\n",
"\n",
"# Output folder for results\n",
"OUTPUT_FOLDER = \"results\"\n",
"os.makedirs(OUTPUT_FOLDER, exist_ok=True)\n",
"\n",
"# Number of concurrent trials = number of workers\n",
"NUM_WORKERS = len(WORKER_URLS)"
]
},
{
"cell_type": "code",
"execution_count": 4,
"id": "health-check",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:01.849199Z",
"iopub.status.busy": "2026-01-18T07:15:01.849135Z",
"iopub.status.idle": "2026-01-18T07:15:01.856150Z",
"shell.execute_reply": "2026-01-18T07:15:01.855789Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.008777,
"end_time": "2026-01-18T07:15:01.856430",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.847653",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"✓ http://localhost:8001: ok (GPU: None)\n",
"✓ http://localhost:8002: ok (GPU: None)\n",
"\n",
"2/2 workers ready for parallel tuning\n"
]
}
],
"source": [
"# Verify all workers are running\n",
"healthy_workers = []\n",
"for url in WORKER_URLS:\n",
" try:\n",
" health = requests.get(f\"{url}/health\", timeout=10).json()\n",
" if health['status'] == 'ok' and health['model_loaded']:\n",
" healthy_workers.append(url)\n",
" print(f\"✓ {url}: {health['status']} (GPU: {health.get('gpu_name', 'N/A')})\")\n",
" else:\n",
" print(f\"✗ {url}: not ready yet\")\n",
" except requests.exceptions.ConnectionError:\n",
" print(f\"✗ {url}: not reachable\")\n",
"\n",
"if not healthy_workers:\n",
" raise RuntimeError(\n",
" \"No healthy workers found. Start them with:\\n\"\n",
" \" cd src/paddle_ocr && docker compose -f docker-compose.workers.yml up\"\n",
" )\n",
"\n",
"print(f\"\\n{len(healthy_workers)}/{len(WORKER_URLS)} workers ready for parallel tuning\")"
]
},
{
"cell_type": "markdown",
"id": "search-space-header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.001067,
"end_time": "2026-01-18T07:15:01.858650",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.857583",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 3. Search Space"
]
},
{
"cell_type": "code",
"execution_count": 5,
"id": "search-space",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:01.861275Z",
"iopub.status.busy": "2026-01-18T07:15:01.861205Z",
"iopub.status.idle": "2026-01-18T07:15:01.863429Z",
"shell.execute_reply": "2026-01-18T07:15:01.863034Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.004046,
"end_time": "2026-01-18T07:15:01.863788",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.859742",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [],
"source": [
"search_space = {\n",
" # Whether to use document image orientation classification\n",
" \"use_doc_orientation_classify\": tune.choice([True, False]),\n",
" # Whether to use text image unwarping\n",
" \"use_doc_unwarping\": tune.choice([True, False]),\n",
" # Whether to use text line orientation classification\n",
" \"textline_orientation\": tune.choice([True, False]),\n",
" # Detection pixel threshold (pixels > threshold are considered text)\n",
" \"text_det_thresh\": tune.uniform(0.0, 0.7),\n",
" # Detection box threshold (average score within border)\n",
" \"text_det_box_thresh\": tune.uniform(0.0, 0.7),\n",
" # Text detection expansion coefficient\n",
" \"text_det_unclip_ratio\": tune.choice([0.0]),\n",
" # Text recognition threshold (filter low confidence results)\n",
" \"text_rec_score_thresh\": tune.uniform(0.0, 0.7),\n",
"}"
]
},
{
"cell_type": "markdown",
"id": "trainable-header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.001064,
"end_time": "2026-01-18T07:15:01.865979",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.864915",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 4. Trainable Function"
]
},
{
"cell_type": "code",
"execution_count": 6,
"id": "trainable",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:01.868751Z",
"iopub.status.busy": "2026-01-18T07:15:01.868656Z",
"iopub.status.idle": "2026-01-18T07:15:01.871950Z",
"shell.execute_reply": "2026-01-18T07:15:01.871453Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.005245,
"end_time": "2026-01-18T07:15:01.872296",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.867051",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [],
"source": [
"def trainable_paddle_ocr(config):\n",
" \"\"\"Call PaddleOCR REST API with the given hyperparameter config.\n",
" \n",
" Uses trial index to deterministically assign a worker (round-robin),\n",
" ensuring only 1 request per container at a time.\n",
" \"\"\"\n",
" import requests # Must be inside function for Ray workers\n",
" from ray import train\n",
"\n",
" # Worker URLs - round-robin assignment based on trial index\n",
" WORKER_PORTS = [8001, 8002]\n",
" NUM_WORKERS = len(WORKER_PORTS)\n",
" \n",
" # Get trial context for deterministic worker assignment\n",
" context = train.get_context()\n",
" trial_id = context.get_trial_id() if context else \"0\"\n",
" # Extract numeric part from trial ID (e.g., \"trainable_paddle_ocr_abc123_00001\" -> 1)\n",
" try:\n",
" trial_num = int(trial_id.split(\"_\")[-1])\n",
" except (ValueError, IndexError):\n",
" trial_num = hash(trial_id)\n",
" \n",
" worker_idx = trial_num % NUM_WORKERS\n",
" api_url = f\"http://localhost:{WORKER_PORTS[worker_idx]}\"\n",
"\n",
" payload = {\n",
" \"pdf_folder\": \"/app/dataset\",\n",
" \"use_doc_orientation_classify\": config.get(\"use_doc_orientation_classify\", False),\n",
" \"use_doc_unwarping\": config.get(\"use_doc_unwarping\", False),\n",
" \"textline_orientation\": config.get(\"textline_orientation\", True),\n",
" \"text_det_thresh\": config.get(\"text_det_thresh\", 0.0),\n",
" \"text_det_box_thresh\": config.get(\"text_det_box_thresh\", 0.0),\n",
" \"text_det_unclip_ratio\": config.get(\"text_det_unclip_ratio\", 1.5),\n",
" \"text_rec_score_thresh\": config.get(\"text_rec_score_thresh\", 0.0),\n",
" \"start_page\": 5,\n",
" \"end_page\": 10,\n",
" }\n",
"\n",
" try:\n",
2026-01-18 08:20:24 +01:00
" response = requests.post(f\"{api_url}/evaluate\", json=payload, timeout=None) # No timeout\n",
2026-01-18 08:19:34 +01:00
" response.raise_for_status()\n",
" metrics = response.json()\n",
" metrics[\"worker\"] = api_url\n",
" train.report(metrics)\n",
" except Exception as e:\n",
" train.report({\n",
" \"CER\": 1.0,\n",
" \"WER\": 1.0,\n",
" \"TIME\": 0.0,\n",
" \"PAGES\": 0,\n",
" \"TIME_PER_PAGE\": 0,\n",
" \"worker\": api_url,\n",
" \"ERROR\": str(e)[:500]\n",
" })"
]
},
{
"cell_type": "markdown",
"id": "tuner-header",
"metadata": {
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 0.001042,
"end_time": "2026-01-18T07:15:01.874467",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.873425",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"source": [
"## 5. Run Tuner"
]
},
{
"cell_type": "code",
"execution_count": 7,
"id": "ray-init",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:01.877636Z",
"iopub.status.busy": "2026-01-18T07:15:01.877526Z",
"iopub.status.idle": "2026-01-18T07:15:04.527343Z",
"shell.execute_reply": "2026-01-18T07:15:04.526869Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 2.652439,
"end_time": "2026-01-18T07:15:04.527996",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:01.875557",
2026-01-18 08:19:34 +01:00
"status": "completed"
},
"tags": []
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:03,149\tINFO worker.py:2007 -- Started a local Ray instance.\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"Ray Tune ready (version: 2.53.0)\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py:2046: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0\n",
" warnings.warn(\n"
]
}
],
"source": [
"ray.init(ignore_reinit_error=True)\n",
"print(f\"Ray Tune ready (version: {ray.__version__})\")"
]
},
{
"cell_type": "code",
"execution_count": 8,
"id": "tuner",
"metadata": {
"execution": {
2026-01-18 08:20:24 +01:00
"iopub.execute_input": "2026-01-18T07:15:04.542083Z",
"iopub.status.busy": "2026-01-18T07:15:04.541579Z",
"iopub.status.idle": "2026-01-18T07:16:51.740809Z",
"shell.execute_reply": "2026-01-18T07:16:51.740224Z"
2026-01-18 08:19:34 +01:00
},
"papermill": {
2026-01-18 08:20:24 +01:00
"duration": 107.210662,
"end_time": "2026-01-18T07:16:51.741577",
2026-01-18 08:19:34 +01:00
"exception": false,
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:15:04.530915",
"status": "completed"
2026-01-18 08:19:34 +01:00
},
"tags": []
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/impl/tuner_internal.py:144: RayDeprecationWarning: The `RunConfig` class should be imported from `ray.tune` when passing it to the Tuner. Please update your imports. See this issue for more context and migration options: https://github.com/ray-project/ray/issues/49454. Disable these warnings by setting the environment variable: RAY_TRAIN_ENABLE_V2_MIGRATION_WARNINGS=0\n",
" _log_deprecation_warning(\n",
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:04,548\tINFO tune.py:616 -- [output] This uses the legacy output and progress reporter, as Jupyter notebooks are not supported by the new engine, yet. For more information, please see https://github.com/ray-project/ray/issues/36949\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"[I 2026-01-18 08:15:04,550] A new study created in memory with name: optuna\n"
2026-01-18 08:19:34 +01:00
]
},
{
"data": {
"text/html": [
"<div class=\"tuneStatus\">\n",
" <div style=\"display: flex;flex-direction: row\">\n",
" <div style=\"display: flex;flex-direction: column;\">\n",
" <h3>Tune Status</h3>\n",
" <table>\n",
"<tbody>\n",
2026-01-18 08:20:24 +01:00
"<tr><td>Current time:</td><td>2026-01-18 08:16:51</td></tr>\n",
"<tr><td>Running for: </td><td>00:01:47.13 </td></tr>\n",
"<tr><td>Memory: </td><td>9.3/119.7 GiB </td></tr>\n",
2026-01-18 08:19:34 +01:00
"</tbody>\n",
"</table>\n",
" </div>\n",
" <div class=\"vDivider\"></div>\n",
" <div class=\"systemInfo\">\n",
" <h3>System Info</h3>\n",
" Using FIFO scheduling algorithm.<br>Logical resource usage: 1.0/20 CPUs, 0/1 GPUs (0.0/1.0 accelerator_type:GB10)\n",
" </div>\n",
" <div class=\"vDivider\"></div>\n",
"<div class=\"messages\">\n",
" <h3>Messages</h3>\n",
" \n",
2026-01-18 08:20:24 +01:00
" \n",
" Number of errored trials: 64<br><table>\n",
2026-01-18 08:19:34 +01:00
"<thead>\n",
"<tr><th>Trial name </th><th style=\"text-align: right;\"> # failures</th><th>error file </th></tr>\n",
"</thead>\n",
"<tbody>\n",
2026-01-18 08:20:24 +01:00
"<tr><td>trainable_paddle_ocr_6bf31ec4</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_6bf31ec4_1_text_det_box_thresh=0.3903,text_det_thresh=0.0894,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-04/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_0581bc7f</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_0581bc7f_2_text_det_box_thresh=0.6285,text_det_thresh=0.4307,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-06/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2b294ccd</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_2b294ccd_3_text_det_box_thresh=0.3592,text_det_thresh=0.5692,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-07/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_863cf92d</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_863cf92d_4_text_det_box_thresh=0.4625,text_det_thresh=0.6531,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-09/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_4d80d6bc</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_4d80d6bc_5_text_det_box_thresh=0.3074,text_det_thresh=0.5779,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-11/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_88f5b99b</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_88f5b99b_6_text_det_box_thresh=0.4628,text_det_thresh=0.2964,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-12/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b94bd663</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_b94bd663_7_text_det_box_thresh=0.0646,text_det_thresh=0.0740,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-14/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a7a8d797</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_a7a8d797_8_text_det_box_thresh=0.2400,text_det_thresh=0.2066,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-16/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e2458073</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_e2458073_9_text_det_box_thresh=0.3950,text_det_thresh=0.0939,text_det_unclip_ratio=0.0000,text_rec_score_thre_2026-01-18_08-15-17/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_8bd28b94</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_8bd28b94_10_text_det_box_thresh=0.4158,text_det_thresh=0.1052,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-19/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6a87d6ec</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_6a87d6ec_11_text_det_box_thresh=0.0418,text_det_thresh=0.5340,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-21/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_20800023</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_20800023_12_text_det_box_thresh=0.6455,text_det_thresh=0.3654,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-22/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_ece7ddc1</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_ece7ddc1_13_text_det_box_thresh=0.3177,text_det_thresh=0.1642,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-24/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9881d38</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_a9881d38_14_text_det_box_thresh=0.6594,text_det_thresh=0.5420,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-26/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_c8ec82a9</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_c8ec82a9_15_text_det_box_thresh=0.6487,text_det_thresh=0.3307,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-27/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b52158c0</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_b52158c0_16_text_det_box_thresh=0.0268,text_det_thresh=0.5331,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-29/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d3826db6</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_d3826db6_17_text_det_box_thresh=0.5079,text_det_thresh=0.4743,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-31/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b8f7a481</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_b8f7a481_18_text_det_box_thresh=0.5483,text_det_thresh=0.6201,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-33/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_26af04f8</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_26af04f8_19_text_det_box_thresh=0.1941,text_det_thresh=0.1427,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-34/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b0bee75d</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_b0bee75d_20_text_det_box_thresh=0.6083,text_det_thresh=0.4114,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-36/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_3e30b123</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_3e30b123_21_text_det_box_thresh=0.0779,text_det_thresh=0.6198,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-38/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d50d01d2</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_d50d01d2_22_text_det_box_thresh=0.0593,text_det_thresh=0.0692,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-39/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_09c1df0f</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_09c1df0f_23_text_det_box_thresh=0.6243,text_det_thresh=0.1191,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-41/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_eb9ce9f6</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_eb9ce9f6_24_text_det_box_thresh=0.6459,text_det_thresh=0.6878,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-43/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_530965e3</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_530965e3_25_text_det_box_thresh=0.3435,text_det_thresh=0.5321,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-44/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_64035cd3</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_64035cd3_26_text_det_box_thresh=0.6553,text_det_thresh=0.3534,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-46/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_76e99ffa</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_76e99ffa_27_text_det_box_thresh=0.3241,text_det_thresh=0.4626,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-48/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_356e1b30</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_356e1b30_28_text_det_box_thresh=0.3883,text_det_thresh=0.1804,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-49/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_c1dac62d</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_c1dac62d_29_text_det_box_thresh=0.1544,text_det_thresh=0.1679,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-51/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_47e4370a</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_47e4370a_30_text_det_box_thresh=0.4857,text_det_thresh=0.6673,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-53/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_619e0df6</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_619e0df6_31_text_det_box_thresh=0.0503,text_det_thresh=0.5872,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-54/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_1ba6186e</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_1ba6186e_32_text_det_box_thresh=0.0982,text_det_thresh=0.4596,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-56/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_f3acfd65</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_f3acfd65_33_text_det_box_thresh=0.2579,text_det_thresh=0.4026,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-58/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2eeab47b</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_2eeab47b_34_text_det_box_thresh=0.2556,text_det_thresh=0.0288,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-15-59/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_41c7a0dd</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_41c7a0dd_35_text_det_box_thresh=0.4860,text_det_thresh=0.1406,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-01/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d4a3b4ec</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_d4a3b4ec_36_text_det_box_thresh=0.4130,text_det_thresh=0.5181,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-03/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e34318fc</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_e34318fc_37_text_det_box_thresh=0.4892,text_det_thresh=0.5103,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-04/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2947584e</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_2947584e_38_text_det_box_thresh=0.2107,text_det_thresh=0.2868,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-06/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_ba985826</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_ba985826_39_text_det_box_thresh=0.1259,text_det_thresh=0.1693,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-08/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_069a81ff</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_069a81ff_40_text_det_box_thresh=0.3772,text_det_thresh=0.1206,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-09/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_26a86e10</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_26a86e10_41_text_det_box_thresh=0.2260,text_det_thresh=0.4213,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-11/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a2dec12b</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_a2dec12b_42_text_det_box_thresh=0.3576,text_det_thresh=0.6193,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-13/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a329183c</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_a329183c_43_text_det_box_thresh=0.0591,text_det_thresh=0.4260,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-14/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_01afde9f</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_01afde9f_44_text_det_box_thresh=0.4478,text_det_thresh=0.4019,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-16/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_99e58d9c</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_99e58d9c_45_text_det_box_thresh=0.2931,text_det_thresh=0.2685,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-18/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_abfa2d00</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_abfa2d00_46_text_det_box_thresh=0.5342,text_det_thresh=0.2225,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-19/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_0a01ad75</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_0a01ad75_47_text_det_box_thresh=0.2605,text_det_thresh=0.4041,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-21/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_74efac41</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_74efac41_48_text_det_box_thresh=0.3317,text_det_thresh=0.6152,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-23/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e13823ba</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_e13823ba_49_text_det_box_thresh=0.6187,text_det_thresh=0.6859,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-24/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_8f0f284c</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_8f0f284c_50_text_det_box_thresh=0.6318,text_det_thresh=0.3441,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-26/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e92d7cd3</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_e92d7cd3_51_text_det_box_thresh=0.4227,text_det_thresh=0.4409,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-28/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_4df0b874</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_4df0b874_52_text_det_box_thresh=0.6761,text_det_thresh=0.1009,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-29/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_fdb7072f</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_fdb7072f_53_text_det_box_thresh=0.1377,text_det_thresh=0.6217,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-31/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9a71e45</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_a9a71e45_54_text_det_box_thresh=0.0547,text_det_thresh=0.3294,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-33/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_cd15bd1d</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_cd15bd1d_55_text_det_box_thresh=0.5698,text_det_thresh=0.3256,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-35/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_aac57e7c</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_aac57e7c_56_text_det_box_thresh=0.5948,text_det_thresh=0.2095,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-36/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_5cb5762f</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_5cb5762f_57_text_det_box_thresh=0.1412,text_det_thresh=0.5146,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-38/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6ee2a3ed</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_6ee2a3ed_58_text_det_box_thresh=0.3299,text_det_thresh=0.0919,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-40/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_9ef78737</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_9ef78737_59_text_det_box_thresh=0.3112,text_det_thresh=0.2598,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-41/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6f3d237a</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_6f3d237a_60_text_det_box_thresh=0.6768,text_det_thresh=0.0321,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-43/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b2dc1001</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_b2dc1001_61_text_det_box_thresh=0.3452,text_det_thresh=0.0194,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-45/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d9c91163</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_d9c91163_62_text_det_box_thresh=0.3979,text_det_thresh=0.5021,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-46/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_1cdb6cf0</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_1cdb6cf0_63_text_det_box_thresh=0.3075,text_det_thresh=0.4003,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-48/error.txt</td></tr>\n",
"<tr><td>trainable_paddle_ocr_7bad4799</td><td style=\"text-align: right;\"> 1</td><td>/tmp/ray/session_2026-01-18_08-15-01_894245_1179535/artifacts/2026-01-18_08-15-04/trainable_paddle_ocr_2026-01-18_08-15-04/driver_artifacts/trainable_paddle_ocr_7bad4799_64_text_det_box_thresh=0.4232,text_det_thresh=0.6435,text_det_unclip_ratio=0.0000,text_rec_score_thr_2026-01-18_08-16-49/error.txt</td></tr>\n",
2026-01-18 08:19:34 +01:00
"</tbody>\n",
"</table>\n",
"</div>\n",
"<style>\n",
".messages {\n",
" color: var(--jp-ui-font-color1);\n",
" display: flex;\n",
" flex-direction: column;\n",
" padding-left: 1em;\n",
" overflow-y: auto;\n",
"}\n",
".messages h3 {\n",
" font-weight: bold;\n",
"}\n",
".vDivider {\n",
" border-left-width: var(--jp-border-width);\n",
" border-left-color: var(--jp-border-color0);\n",
" border-left-style: solid;\n",
" margin: 0.5em 1em 0.5em 1em;\n",
"}\n",
"</style>\n",
"\n",
" </div>\n",
" <div class=\"hDivider\"></div>\n",
" <div class=\"trialStatus\">\n",
" <h3>Trial Status</h3>\n",
" <table>\n",
"<thead>\n",
"<tr><th>Trial name </th><th>status </th><th>loc </th><th style=\"text-align: right;\"> text_det_box_thresh</th><th style=\"text-align: right;\"> text_det_thresh</th><th style=\"text-align: right;\"> text_det_unclip_rati\n",
2026-01-18 08:20:24 +01:00
"o</th><th style=\"text-align: right;\"> text_rec_score_thres\n",
2026-01-18 08:19:34 +01:00
"h</th><th>textline_orientation </th><th>use_doc_orientation_\n",
"classify </th><th>use_doc_unwarping </th></tr>\n",
"</thead>\n",
"<tbody>\n",
2026-01-18 08:20:24 +01:00
"<tr><td>trainable_paddle_ocr_6bf31ec4</td><td>ERROR </td><td>192.168.65.140:1180996</td><td style=\"text-align: right;\"> 0.39032 </td><td style=\"text-align: right;\"> 0.0893503</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.510144 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_0581bc7f</td><td>ERROR </td><td>192.168.65.140:1181076</td><td style=\"text-align: right;\"> 0.628538 </td><td style=\"text-align: right;\"> 0.430734 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.572028 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_2b294ccd</td><td>ERROR </td><td>192.168.65.140:1181140</td><td style=\"text-align: right;\"> 0.35917 </td><td style=\"text-align: right;\"> 0.569189 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.398691 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_863cf92d</td><td>ERROR </td><td>192.168.65.140:1181233</td><td style=\"text-align: right;\"> 0.462526 </td><td style=\"text-align: right;\"> 0.65313 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.201286 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_4d80d6bc</td><td>ERROR </td><td>192.168.65.140:1181337</td><td style=\"text-align: right;\"> 0.307405 </td><td style=\"text-align: right;\"> 0.577876 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.123351 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_88f5b99b</td><td>ERROR </td><td>192.168.65.140:1181396</td><td style=\"text-align: right;\"> 0.462808 </td><td style=\"text-align: right;\"> 0.296416 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0991077 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_b94bd663</td><td>ERROR </td><td>192.168.65.140:1181454</td><td style=\"text-align: right;\"> 0.0646412</td><td style=\"text-align: right;\"> 0.0739638</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.132554 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_a7a8d797</td><td>ERROR </td><td>192.168.65.140:1181540</td><td style=\"text-align: right;\"> 0.239973 </td><td style=\"text-align: right;\"> 0.206588 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.038023 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_e2458073</td><td>ERROR </td><td>192.168.65.140:1181601</td><td style=\"text-align: right;\"> 0.395005 </td><td style=\"text-align: right;\"> 0.0938773</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.207557 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_8bd28b94</td><td>ERROR </td><td>192.168.65.140:1181679</td><td style=\"text-align: right;\"> 0.415785 </td><td style=\"text-align: right;\"> 0.105178 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.237575 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_6a87d6ec</td><td>ERROR </td><td>192.168.65.140:1181748</td><td style=\"text-align: right;\"> 0.0417775</td><td style=\"text-align: right;\"> 0.533986 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.655555 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_20800023</td><td>ERROR </td><td>192.168.65.140:1181809</td><td style=\"text-align: right;\"> 0.64549 </td><td style=\"text-align: right;\"> 0.365376 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.450362 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_ece7ddc1</td><td>ERROR </td><td>192.168.65.140:1181885</td><td style=\"text-align: right;\"> 0.317738 </td><td style=\"text-align: right;\"> 0.164245 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.119151 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9881d38</td><td>ERROR </td><td>192.168.65.140:1181978</td><td style=\"text-align: right;\"> 0.659372 </td><td style=\"text-align: right;\"> 0.542042 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.433649 </td><td>False </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_c8ec82a9</td><td>ERROR </td><td>192.168.65.140:1182052</td><td style=\"text-align: right;\"> 0.648651 </td><td style=\"text-align: right;\"> 0.330737 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.635815 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_b52158c0</td><td>ERROR </td><td>192.168.65.140:1182135</td><td style=\"text-align: right;\"> 0.0267739</td><td style=\"text-align: right;\"> 0.53311 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.309056 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_d3826db6</td><td>ERROR </td><td>192.168.65.140:1182203</td><td style=\"text-align: right;\"> 0.507855 </td><td style=\"text-align: right;\"> 0.474303 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.323979 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_b8f7a481</td><td>ERROR </td><td>192.168.65.140:1182281</td><td style=\"text-align: right;\"> 0.548293 </td><td style=\"text-align: right;\"> 0.620087 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.123661 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_26af04f8</td><td>ERROR </td><td>192.168.65.140:1182349</td><td style=\"text-align: right;\"> 0.194097 </td><td style=\"text-align: right;\"> 0.142677 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.646631 </td><td>False </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_b0bee75d</td><td>ERROR </td><td>192.168.65.140:1182444</td><td style=\"text-align: right;\"> 0.608299 </td><td style=\"text-align: right;\"> 0.411435 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.586333 </td><td>False </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_3e30b123</td><td>ERROR </td><td>192.168.65.140:1182501</td><td style=\"text-align: right;\"> 0.0779434</td><td style=\"text-align: right;\"> 0.619831 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.599645 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_d50d01d2</td><td>ERROR </td><td>192.168.65.140:1182574</td><td style=\"text-align: right;\"> 0.0593152</td><td style=\"text-align: right;\"> 0.0692179</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.298712 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_09c1df0f</td><td>ERROR </td><td>192.168.65.140:1182699</td><td style=\"text-align: right;\"> 0.62431 </td><td style=\"text-align: right;\"> 0.119079 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.169161 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_eb9ce9f6</td><td>ERROR </td><td>192.168.65.140:1182778</td><td style=\"text-align: right;\"> 0.64586 </td><td style=\"text-align: right;\"> 0.687753 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.617925 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_530965e3</td><td>ERROR </td><td>192.168.65.140:1182848</td><td style=\"text-align: right;\"> 0.343468 </td><td style=\"text-align: right;\"> 0.532107 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.354731 </td><td>True </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_64035cd3</td><td>ERROR </td><td>192.168.65.140:1182917</td><td style=\"text-align: right;\"> 0.655316 </td><td style=\"text-align: right;\"> 0.353411 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.590635 </td><td>False </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_76e99ffa</td><td>ERROR </td><td>192.168.65.140:1182976</td><td style=\"text-align: right;\"> 0.324144 </td><td style=\"text-align: right;\"> 0.462554 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.432215 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_356e1b30</td><td>ERROR </td><td>192.168.65.140:1183046</td><td style=\"text-align: right;\"> 0.388325 </td><td style=\"text-align: right;\"> 0.180412 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.539149 </td><td>False </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_c1dac62d</td><td>ERROR </td><td>192.168.65.140:1183115</td><td style=\"text-align: right;\"> 0.154434 </td><td style=\"text-align: right;\"> 0.16788 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.659353 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_47e4370a</td><td>ERROR </td><td>192.168.65.140:1183174</td><td style=\"text-align: right;\"> 0.485723 </td><td style=\"text-align: right;\"> 0.667272 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.495147 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_619e0df6</td><td>ERROR </td><td>192.168.65.140:1183244</td><td style=\"text-align: right;\"> 0.0503144</td><td style=\"text-align: right;\"> 0.587223 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.660952 </td><td>True </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_1ba6186e</td><td>ERROR </td><td>192.168.65.140:1183313</td><td style=\"text-align: right;\"> 0.0981667</td><td style=\"text-align: right;\"> 0.459631 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.570227 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_f3acfd65</td><td>ERROR </td><td>192.168.65.140:1183372</td><td style=\"text-align: right;\"> 0.257882 </td><td style=\"text-align: right;\"> 0.402552 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.697082 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_2eeab47b</td><td>ERROR </td><td>192.168.65.140:1183443</td><td style=\"text-align: right;\"> 0.255588 </td><td style=\"text-align: right;\"> 0.0287627</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.26564 </td><td>False </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_41c7a0dd</td><td>ERROR </td><td>192.168.65.140:1183515</td><td style=\"text-align: right;\"> 0.486041 </td><td style=\"text-align: right;\"> 0.140558 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0113787 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_d4a3b4ec</td><td>ERROR </td><td>192.168.65.140:1183592</td><td style=\"text-align: right;\"> 0.413047 </td><td style=\"text-align: right;\"> 0.518129 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0847272 </td><td>False </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_e34318fc</td><td>ERROR </td><td>192.168.65.140:1183662</td><td style=\"text-align: right;\"> 0.489181 </td><td style=\"text-align: right;\"> 0.510287 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.575766 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_2947584e</td><td>ERROR </td><td>192.168.65.140:1183736</td><td style=\"text-align: right;\"> 0.210651 </td><td style=\"text-align: right;\"> 0.286823 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0394218 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_ba985826</td><td>ERROR </td><td>192.168.65.140:1183796</td><td style=\"text-align: right;\"> 0.125918 </td><td style=\"text-align: right;\"> 0.169266 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.567154 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_069a81ff</td><td>ERROR </td><td>192.168.65.140:1183866</td><td style=\"text-align: right;\"> 0.377151 </td><td style=\"text-align: right;\"> 0.120571 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.461722 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_26a86e10</td><td>ERROR </td><td>192.168.65.140:1183970</td><td style=\"text-align: right;\"> 0.226007 </td><td style=\"text-align: right;\"> 0.42126 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.552411 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_a2dec12b</td><td>ERROR </td><td>192.168.65.140:1184029</td><td style=\"text-align: right;\"> 0.357629 </td><td style=\"text-align: right;\"> 0.61926 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.377764 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_a329183c</td><td>ERROR </td><td>192.168.65.140:1184100</td><td style=\"text-align: right;\"> 0.0590931</td><td style=\"text-align: right;\"> 0.426047 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.413968 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_01afde9f</td><td>ERROR </td><td>192.168.65.140:1184170</td><td style=\"text-align: right;\"> 0.447814 </td><td style=\"text-align: right;\"> 0.401888 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.402544 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_99e58d9c</td><td>ERROR </td><td>192.168.65.140:1184228</td><td style=\"text-align: right;\"> 0.293092 </td><td style=\"text-align: right;\"> 0.268454 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.388751 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_abfa2d00</td><td>ERROR </td><td>192.168.65.140:1184298</td><td style=\"text-align: right;\"> 0.534151 </td><td style=\"text-align: right;\"> 0.222465 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.364601 </td><td>False </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_0a01ad75</td><td>ERROR </td><td>192.168.65.140:1184370</td><td style=\"text-align: right;\"> 0.260459 </td><td style=\"text-align: right;\"> 0.404148 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.632166 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_74efac41</td><td>ERROR </td><td>192.168.65.140:1184430</td><td style=\"text-align: right;\"> 0.331729 </td><td style=\"text-align: right;\"> 0.615152 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.204964 </td><td>False </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_e13823ba</td><td>ERROR </td><td>192.168.65.140:1184500</td><td style=\"text-align: right;\"> 0.618669 </td><td style=\"text-align: right;\"> 0.685865 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.42536 </td><td>True </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_8f0f284c</td><td>ERROR </td><td>192.168.65.140:1184570</td><td style=\"text-align: right;\"> 0.631841 </td><td style=\"text-align: right;\"> 0.344078 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0336681 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_e92d7cd3</td><td>ERROR </td><td>192.168.65.140:1184629</td><td style=\"text-align: right;\"> 0.422668 </td><td style=\"text-align: right;\"> 0.440932 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.482034 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_4df0b874</td><td>ERROR </td><td>192.168.65.140:1184699</td><td style=\"text-align: right;\"> 0.676074 </td><td style=\"text-align: right;\"> 0.100945 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.164867 </td><td>False </td><td>False</td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_fdb7072f</td><td>ERROR </td><td>192.168.65.140:1184767</td><td style=\"text-align: right;\"> 0.137672 </td><td style=\"text-align: right;\"> 0.621699 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0949795 </td><td>True </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9a71e45</td><td>ERROR </td><td>192.168.65.140:1184845</td><td style=\"text-align: right;\"> 0.0547467</td><td style=\"text-align: right;\"> 0.329374 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.129005 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_cd15bd1d</td><td>ERROR </td><td>192.168.65.140:1184916</td><td style=\"text-align: right;\"> 0.569787 </td><td style=\"text-align: right;\"> 0.325571 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.00887252</td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_aac57e7c</td><td>ERROR </td><td>192.168.65.140:1184991</td><td style=\"text-align: right;\"> 0.594832 </td><td style=\"text-align: right;\"> 0.209511 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.576989 </td><td>True </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_5cb5762f</td><td>ERROR </td><td>192.168.65.140:1185050</td><td style=\"text-align: right;\"> 0.141233 </td><td style=\"text-align: right;\"> 0.514643 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.166991 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_6ee2a3ed</td><td>ERROR </td><td>192.168.65.140:1185121</td><td style=\"text-align: right;\"> 0.329948 </td><td style=\"text-align: right;\"> 0.091881 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.0565286 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_9ef78737</td><td>ERROR </td><td>192.168.65.140:1185233</td><td style=\"text-align: right;\"> 0.311238 </td><td style=\"text-align: right;\"> 0.259813 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.395532 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_6f3d237a</td><td>ERROR </td><td>192.168.65.140:1185291</td><td style=\"text-align: right;\"> 0.67676 </td><td style=\"text-align: right;\"> 0.0321045</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.12651 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_b2dc1001</td><td>ERROR </td><td>192.168.65.140:1185361</td><td style=\"text-align: right;\"> 0.345218 </td><td style=\"text-align: right;\"> 0.0194089</td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.373212 </td><td>True </td><td>False</td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_d9c91163</td><td>ERROR </td><td>192.168.65.140:1185425</td><td style=\"text-align: right;\"> 0.397871 </td><td style=\"text-align: right;\"> 0.5021 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.575078 </td><td>False </td><td>True </td><td>True </td></tr>\n",
"<tr><td>trainable_paddle_ocr_1cdb6cf0</td><td>ERROR </td><td>192.168.65.140:1185482</td><td style=\"text-align: right;\"> 0.307529 </td><td style=\"text-align: right;\"> 0.400274 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.645179 </td><td>False </td><td>True </td><td>False </td></tr>\n",
"<tr><td>trainable_paddle_ocr_7bad4799</td><td>ERROR </td><td>192.168.65.140:1185549</td><td style=\"text-align: right;\"> 0.423169 </td><td style=\"text-align: right;\"> 0.643454 </td><td style=\"text-align: right;\">0</td><td style=\"text-align: right;\">0.421445 </td><td>False </td><td>False</td><td>False </td></tr>\n",
2026-01-18 08:19:34 +01:00
"</tbody>\n",
"</table>\n",
" </div>\n",
"</div>\n",
"<style>\n",
".tuneStatus {\n",
" color: var(--jp-ui-font-color1);\n",
"}\n",
".tuneStatus .systemInfo {\n",
" display: flex;\n",
" flex-direction: column;\n",
"}\n",
".tuneStatus td {\n",
" white-space: nowrap;\n",
"}\n",
".tuneStatus .trialStatus {\n",
" display: flex;\n",
" flex-direction: column;\n",
"}\n",
".tuneStatus h3 {\n",
" font-weight: bold;\n",
"}\n",
".tuneStatus .hDivider {\n",
" border-bottom-width: var(--jp-border-width);\n",
" border-bottom-color: var(--jp-border-color0);\n",
" border-bottom-style: solid;\n",
"}\n",
".tuneStatus .vDivider {\n",
" border-left-width: var(--jp-border-width);\n",
" border-left-color: var(--jp-border-color0);\n",
" border-left-style: solid;\n",
" margin: 0.5em 1em 0.5em 1em;\n",
"}\n",
"</style>\n"
],
"text/plain": [
"<IPython.core.display.HTML object>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:06,314\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_6bf31ec4\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1180996, ip=192.168.65.140, actor_id=f5e312adbb4889107ded878001000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"data": {
"text/html": [
"<div class=\"trialProgress\">\n",
" <h3>Trial Progress</h3>\n",
" <table>\n",
"<thead>\n",
"<tr><th>Trial name </th></tr>\n",
"</thead>\n",
"<tbody>\n",
2026-01-18 08:20:24 +01:00
"<tr><td>trainable_paddle_ocr_01afde9f</td></tr>\n",
"<tr><td>trainable_paddle_ocr_0581bc7f</td></tr>\n",
"<tr><td>trainable_paddle_ocr_069a81ff</td></tr>\n",
"<tr><td>trainable_paddle_ocr_09c1df0f</td></tr>\n",
"<tr><td>trainable_paddle_ocr_0a01ad75</td></tr>\n",
"<tr><td>trainable_paddle_ocr_1ba6186e</td></tr>\n",
"<tr><td>trainable_paddle_ocr_1cdb6cf0</td></tr>\n",
"<tr><td>trainable_paddle_ocr_20800023</td></tr>\n",
"<tr><td>trainable_paddle_ocr_26a86e10</td></tr>\n",
"<tr><td>trainable_paddle_ocr_26af04f8</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2947584e</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2b294ccd</td></tr>\n",
"<tr><td>trainable_paddle_ocr_2eeab47b</td></tr>\n",
"<tr><td>trainable_paddle_ocr_356e1b30</td></tr>\n",
"<tr><td>trainable_paddle_ocr_3e30b123</td></tr>\n",
"<tr><td>trainable_paddle_ocr_41c7a0dd</td></tr>\n",
"<tr><td>trainable_paddle_ocr_47e4370a</td></tr>\n",
"<tr><td>trainable_paddle_ocr_4d80d6bc</td></tr>\n",
"<tr><td>trainable_paddle_ocr_4df0b874</td></tr>\n",
"<tr><td>trainable_paddle_ocr_530965e3</td></tr>\n",
"<tr><td>trainable_paddle_ocr_5cb5762f</td></tr>\n",
"<tr><td>trainable_paddle_ocr_619e0df6</td></tr>\n",
"<tr><td>trainable_paddle_ocr_64035cd3</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6a87d6ec</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6bf31ec4</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6ee2a3ed</td></tr>\n",
"<tr><td>trainable_paddle_ocr_6f3d237a</td></tr>\n",
"<tr><td>trainable_paddle_ocr_74efac41</td></tr>\n",
"<tr><td>trainable_paddle_ocr_76e99ffa</td></tr>\n",
"<tr><td>trainable_paddle_ocr_7bad4799</td></tr>\n",
"<tr><td>trainable_paddle_ocr_863cf92d</td></tr>\n",
"<tr><td>trainable_paddle_ocr_88f5b99b</td></tr>\n",
"<tr><td>trainable_paddle_ocr_8bd28b94</td></tr>\n",
"<tr><td>trainable_paddle_ocr_8f0f284c</td></tr>\n",
"<tr><td>trainable_paddle_ocr_99e58d9c</td></tr>\n",
"<tr><td>trainable_paddle_ocr_9ef78737</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a2dec12b</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a329183c</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a7a8d797</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9881d38</td></tr>\n",
"<tr><td>trainable_paddle_ocr_a9a71e45</td></tr>\n",
"<tr><td>trainable_paddle_ocr_aac57e7c</td></tr>\n",
"<tr><td>trainable_paddle_ocr_abfa2d00</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b0bee75d</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b2dc1001</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b52158c0</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b8f7a481</td></tr>\n",
"<tr><td>trainable_paddle_ocr_b94bd663</td></tr>\n",
"<tr><td>trainable_paddle_ocr_ba985826</td></tr>\n",
"<tr><td>trainable_paddle_ocr_c1dac62d</td></tr>\n",
"<tr><td>trainable_paddle_ocr_c8ec82a9</td></tr>\n",
"<tr><td>trainable_paddle_ocr_cd15bd1d</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d3826db6</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d4a3b4ec</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d50d01d2</td></tr>\n",
"<tr><td>trainable_paddle_ocr_d9c91163</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e13823ba</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e2458073</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e34318fc</td></tr>\n",
"<tr><td>trainable_paddle_ocr_e92d7cd3</td></tr>\n",
"<tr><td>trainable_paddle_ocr_eb9ce9f6</td></tr>\n",
"<tr><td>trainable_paddle_ocr_ece7ddc1</td></tr>\n",
"<tr><td>trainable_paddle_ocr_f3acfd65</td></tr>\n",
"<tr><td>trainable_paddle_ocr_fdb7072f</td></tr>\n",
2026-01-18 08:19:34 +01:00
"</tbody>\n",
"</table>\n",
"</div>\n",
"<style>\n",
".trialProgress {\n",
" display: flex;\n",
" flex-direction: column;\n",
" color: var(--jp-ui-font-color1);\n",
"}\n",
".trialProgress h3 {\n",
" font-weight: bold;\n",
"}\n",
".trialProgress td {\n",
" white-space: nowrap;\n",
"}\n",
"</style>\n"
],
"text/plain": [
"<IPython.core.display.HTML object>"
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:07,995\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_0581bc7f\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181076, ip=192.168.65.140, actor_id=af98e888a25ee22aebf08af601000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:09,641\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_2b294ccd\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181140, ip=192.168.65.140, actor_id=fccaddb49d42c4b75034d84e01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:11,317\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_863cf92d\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181233, ip=192.168.65.140, actor_id=ca83f6b51440fd0ad2fb318a01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:12,962\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_4d80d6bc\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181337, ip=192.168.65.140, actor_id=0b5fd4694305989646ad83e201000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:14,647\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_88f5b99b\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181396, ip=192.168.65.140, actor_id=fd8e299eaab8a0addb4eb5e301000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:16,299\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_b94bd663\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181454, ip=192.168.65.140, actor_id=19aafcdb3a21253f247fa8e101000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:17,952\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_a7a8d797\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181540, ip=192.168.65.140, actor_id=ee92602f062af0eb7a18ee3201000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:19,613\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_e2458073\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181601, ip=192.168.65.140, actor_id=d1c087ce7c208475abfb1bb701000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:21,290\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_8bd28b94\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181679, ip=192.168.65.140, actor_id=56834862666faf790f0ee8b301000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:22,965\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_6a87d6ec\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181748, ip=192.168.65.140, actor_id=6fb7093883a73084c750036501000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:24,647\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_20800023\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181809, ip=192.168.65.140, actor_id=183e37520c70273a4a20d43e01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:26,310\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_ece7ddc1\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181885, ip=192.168.65.140, actor_id=e2ba65135111e7b006f282f701000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:27,999\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_a9881d38\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1181978, ip=192.168.65.140, actor_id=cf24e99d552155cb7063731e01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:29,663\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_c8ec82a9\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182052, ip=192.168.65.140, actor_id=4b0d75f963dcd4af44e6bed101000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:31,345\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_b52158c0\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182135, ip=192.168.65.140, actor_id=15d58cacec8b9dfe6ffff4ad01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"\u001b[36m(pid=gcs_server)\u001b[0m [2026-01-18 08:15:32,039 E 1179675 1179675] (gcs_server) gcs_server.cc:303: Failed to establish connection to the event+metrics exporter agent. Events and metrics will not be exported. Exporter agent status: RpcError: Running out of retries to initialize the metrics agent. rpc_code: 14\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:33,013\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_d3826db6\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182203, ip=192.168.65.140, actor_id=ec5e137492d542ea644d192601000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"\u001b[33m(raylet)\u001b[0m [2026-01-18 08:15:33,076 E 1179837 1179837] (raylet) main.cc:1032: Failed to establish connection to the metrics exporter agent. Metrics will not be exported. Exporter agent status: RpcError: Running out of retries to initialize the metrics agent. rpc_code: 14\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"\u001b[36m(bundle_reservation_check_func pid=1179912)\u001b[0m [2026-01-18 08:15:33,913 E 1179912 1180046] core_worker_process.cc:842: Failed to establish connection to the metrics exporter agent. Metrics will not be exported. Exporter agent status: RpcError: Running out of retries to initialize the metrics agent. rpc_code: 14\n"
2026-01-18 08:19:34 +01:00
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"[2026-01-18 08:15:34,527 E 1179535 1179906] core_worker_process.cc:842: Failed to establish connection to the metrics exporter agent. Metrics will not be exported. Exporter agent status: RpcError: Running out of retries to initialize the metrics agent. rpc_code: 14\n",
"2026-01-18 08:15:34,685\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_b8f7a481\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182281, ip=192.168.65.140, actor_id=45dce51b1ba4afd3e7c10cd801000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:36,376\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_26af04f8\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182349, ip=192.168.65.140, actor_id=4896a1887678c4e1fb70c76701000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:38,060\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_b0bee75d\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182444, ip=192.168.65.140, actor_id=3f00b36fe3b789aaec34308e01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:39,733\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_3e30b123\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182501, ip=192.168.65.140, actor_id=447566906a189dd167fc3ab401000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:41,404\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_d50d01d2\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182574, ip=192.168.65.140, actor_id=289960b32c5e18c4de63547b01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:43,084\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_09c1df0f\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182699, ip=192.168.65.140, actor_id=131d929936a2968bc4a3e0e001000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:44,764\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_eb9ce9f6\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182778, ip=192.168.65.140, actor_id=840018ee38d5a6c92033f19701000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:46,452\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_530965e3\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182848, ip=192.168.65.140, actor_id=cba674a325222edc7441b2ea01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:48,140\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_64035cd3\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182917, ip=192.168.65.140, actor_id=5651619595a1e3ee59379def01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:49,829\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_76e99ffa\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1182976, ip=192.168.65.140, actor_id=2778aca542c3948715dc83f701000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:51,486\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_356e1b30\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183046, ip=192.168.65.140, actor_id=f1cf6666ef830b7012ec8f6101000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:53,170\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_c1dac62d\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183115, ip=192.168.65.140, actor_id=4390a5c13317f268eec7170c01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:54,850\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_47e4370a\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183174, ip=192.168.65.140, actor_id=770a05b62bfebd3ff51471c801000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:56,533\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_619e0df6\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183244, ip=192.168.65.140, actor_id=4f4e4b5e5313c9dce149ac6101000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:58,193\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_1ba6186e\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183313, ip=192.168.65.140, actor_id=0d82ff33fb59abed1a13151401000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:15:59,858\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_f3acfd65\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183372, ip=192.168.65.140, actor_id=f26debac4ee3fe42215a4c1801000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:16:01,531\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_2eeab47b\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183443, ip=192.168.65.140, actor_id=1ae3d6b9022a639a5c00ad5001000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:16:03,205\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_41c7a0dd\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183515, ip=192.168.65.140, actor_id=c6b007205b7e5795bb0c9e6001000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
2026-01-18 08:20:24 +01:00
"2026-01-18 08:16:04,880\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_d4a3b4ec\n",
2026-01-18 08:19:34 +01:00
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
2026-01-18 08:20:24 +01:00
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183592, ip=192.168.65.140, actor_id=809df4b9ccf023c0f54c29cc01000000, repr=trainable_paddle_ocr)\n",
2026-01-18 08:19:34 +01:00
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
2026-01-18 08:20:24 +01:00
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
2026-01-18 08:19:34 +01:00
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
2026-01-18 08:20:24 +01:00
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:06,571\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_e34318fc\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183662, ip=192.168.65.140, actor_id=fb019824feff80ed29affa4f01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
2026-01-18 08:19:34 +01:00
},
2026-01-18 08:20:24 +01:00
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:08,254\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_2947584e\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183736, ip=192.168.65.140, actor_id=908847437054c660746006dd01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:09,894\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_ba985826\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183796, ip=192.168.65.140, actor_id=1d3973d83393b850a601465401000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:11,579\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_069a81ff\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183866, ip=192.168.65.140, actor_id=29b9786b3443cc31d83c3c7f01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:13,263\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_26a86e10\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1183970, ip=192.168.65.140, actor_id=8dd2d9561728363d192d484001000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:14,926\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_a2dec12b\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184029, ip=192.168.65.140, actor_id=9e4b3be4c1a2a1744708f14301000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:16,619\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_a329183c\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184100, ip=192.168.65.140, actor_id=f557ab0763303a0f332453e601000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:18,281\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_01afde9f\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184170, ip=192.168.65.140, actor_id=af4f08e2ef9bd64abf19daaf01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:19,958\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_99e58d9c\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184228, ip=192.168.65.140, actor_id=404e7dd0912d5e902f0a534401000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:21,627\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_abfa2d00\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184298, ip=192.168.65.140, actor_id=476b253566a3eb25baa5b52401000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:23,286\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_0a01ad75\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184370, ip=192.168.65.140, actor_id=eec654fc3b94a11014c61a6d01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:24,955\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_74efac41\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184430, ip=192.168.65.140, actor_id=2ee40537ea045206ebcdafa501000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:26,613\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_e13823ba\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184500, ip=192.168.65.140, actor_id=d350f4e2cedd5e9210eebdfa01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:28,277\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_8f0f284c\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184570, ip=192.168.65.140, actor_id=71c35b41552040c80769ab5501000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:29,952\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_e92d7cd3\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184629, ip=192.168.65.140, actor_id=5d87a4ba7c9fdee4f978805201000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:31,615\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_4df0b874\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184699, ip=192.168.65.140, actor_id=df11e70ba38fa05f40931d3a01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:33,281\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_fdb7072f\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184767, ip=192.168.65.140, actor_id=4ba15903063537ba9a0ebeac01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:35,015\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_a9a71e45\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184845, ip=192.168.65.140, actor_id=1ab7a2a173b68e2036cb0cb601000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:36,680\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_cd15bd1d\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184916, ip=192.168.65.140, actor_id=ad376699afe9c9a7bf8d1b1701000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:38,360\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_aac57e7c\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1184991, ip=192.168.65.140, actor_id=3756aa8ca5114f5f7eb41c5d01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:40,014\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_5cb5762f\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185050, ip=192.168.65.140, actor_id=9ff698ffc1b98bde6699348e01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:41,681\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_6ee2a3ed\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185121, ip=192.168.65.140, actor_id=178748179463bc69377027c001000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:43,331\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_9ef78737\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185233, ip=192.168.65.140, actor_id=50f99ffdc69b142f50e98e6901000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:45,010\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_6f3d237a\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185291, ip=192.168.65.140, actor_id=7a2b60b0592847222376b0a601000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:46,678\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_b2dc1001\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185361, ip=192.168.65.140, actor_id=43b5263c8eada790386d926a01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:48,345\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_d9c91163\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185425, ip=192.168.65.140, actor_id=f3e3821dfe85b576c825928a01000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:49,995\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_1cdb6cf0\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185482, ip=192.168.65.140, actor_id=cea73c455a79e58e6521db5801000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:51,665\tERROR tune_controller.py:1331 -- Trial task failed for trial trainable_paddle_ocr_7bad4799\n",
"Traceback (most recent call last):\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/execution/_internal/event_manager.py\", line 110, in resolve_future\n",
" result = ray.get(future)\n",
" ^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/auto_init_hook.py\", line 22, in auto_init_wrapper\n",
" return fn(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/client_mode_hook.py\", line 104, in wrapper\n",
" return func(*args, **kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 2967, in get\n",
" values, debugger_breakpoint = worker.get_objects(\n",
" ^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/_private/worker.py\", line 1015, in get_objects\n",
" raise value.as_instanceof_cause()\n",
"ray.exceptions.RayTaskError(DeprecationWarning): \u001b[36mray::ImplicitFunc.train()\u001b[39m (pid=1185549, ip=192.168.65.140, actor_id=cd3e9862c074eb2e1f8e143301000000, repr=trainable_paddle_ocr)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/trainable.py\", line 331, in train\n",
" raise skipped from exception_cause(skipped)\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/air/_internal/util.py\", line 98, in run\n",
" self._ret = self._target(*self._args, **self._kwargs)\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 44, in <lambda>\n",
" training_func=lambda: self._trainable_func(self.config),\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/tune/trainable/function_trainable.py\", line 249, in _trainable_func\n",
" output = fn()\n",
" ^^^^\n",
" File \"/tmp/ipykernel_1179535/249718987.py\", line 15, in trainable_paddle_ocr\n",
" File \"/home/sergio/MastersThesis/.venv/lib/python3.12/site-packages/ray/train/v2/_internal/util.py\", line 273, in _wrapped_fn\n",
" raise DeprecationWarning(\n",
"DeprecationWarning: `ray.train.get_context` is deprecated when running in a function passed to Ray Tune. Please use the equivalent `ray.tune` API instead. See this issue for more context: https://github.com/ray-project/ray/issues/49454\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:51,687\tINFO tune.py:1009 -- Wrote the latest version of all result files and experiment state to '/home/sergio/ray_results/trainable_paddle_ocr_2026-01-18_08-15-04' in 0.0167s.\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:51,712\tERROR tune.py:1037 -- Trials did not complete: [trainable_paddle_ocr_6bf31ec4, trainable_paddle_ocr_0581bc7f, trainable_paddle_ocr_2b294ccd, trainable_paddle_ocr_863cf92d, trainable_paddle_ocr_4d80d6bc, trainable_paddle_ocr_88f5b99b, trainable_paddle_ocr_b94bd663, trainable_paddle_ocr_a7a8d797, trainable_paddle_ocr_e2458073, trainable_paddle_ocr_8bd28b94, trainable_paddle_ocr_6a87d6ec, trainable_paddle_ocr_20800023, trainable_paddle_ocr_ece7ddc1, trainable_paddle_ocr_a9881d38, trainable_paddle_ocr_c8ec82a9, trainable_paddle_ocr_b52158c0, trainable_paddle_ocr_d3826db6, trainable_paddle_ocr_b8f7a481, trainable_paddle_ocr_26af04f8, trainable_paddle_ocr_b0bee75d, trainable_paddle_ocr_3e30b123, trainable_paddle_ocr_d50d01d2, trainable_paddle_ocr_09c1df0f, trainable_paddle_ocr_eb9ce9f6, trainable_paddle_ocr_530965e3, trainable_paddle_ocr_64035cd3, trainable_paddle_ocr_76e99ffa, trainable_paddle_ocr_356e1b30, trainable_paddle_ocr_c1dac62d, trainable_paddle_ocr_47e4370a, trainable_paddle_ocr_619e0df6, trainable_paddle_ocr_1ba6186e, trainable_paddle_ocr_f3acfd65, trainable_paddle_ocr_2eeab47b, trainable_paddle_ocr_41c7a0dd, trainable_paddle_ocr_d4a3b4ec, trainable_paddle_ocr_e34318fc, trainable_paddle_ocr_2947584e, trainable_paddle_ocr_ba985826, trainable_paddle_ocr_069a81ff, trainable_paddle_ocr_26a86e10, trainable_paddle_ocr_a2dec12b, trainable_paddle_ocr_a329183c, trainable_paddle_ocr_01afde9f, trainable_paddle_ocr_99e58d9c, trainable_paddle_ocr_abfa2d00, trainable_paddle_ocr_0a01ad75, trainable_paddle_ocr_74efac41, trainable_paddle_ocr_e13823ba, trainable_paddle_ocr_8f0f284c, trainable_paddle_ocr_e92d7cd3, trainable_paddle_ocr_4df0b874, trainable_paddle_ocr_fdb7072f, trainable_paddle_ocr_a9a71e45, trainable_paddle_ocr_cd15bd1d, trainable_paddle_ocr_aac57e7c, trainable_paddle_ocr_5cb5762f, trainable_paddle_ocr_6ee2a3ed, trainable_paddle_ocr_9ef78737, trainable_paddle_ocr_6f3d237a, trainable_paddle_ocr_b2dc1001, trainable_paddle_ocr_d9c91163, trainable_paddle_ocr_1cdb6cf0, trainable_paddle_ocr_7bad4799]\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"2026-01-18 08:16:51,713\tINFO tune.py:1041 -- Total run time: 107.16 seconds (107.11 seconds for the tuning loop).\n"
]
}
],
"source": [
"tuner = tune.Tuner(\n",
" trainable_paddle_ocr,\n",
" tune_config=tune.TuneConfig(\n",
" metric=\"CER\",\n",
" mode=\"min\",\n",
" search_alg=OptunaSearch(),\n",
" num_samples=64,\n",
" max_concurrent_trials=NUM_WORKERS, # Run trials in parallel across workers\n",
" ),\n",
" run_config=air.RunConfig(verbose=2, log_to_file=False),\n",
" param_space=search_space,\n",
")\n",
"\n",
"results = tuner.fit()"
]
},
{
"cell_type": "markdown",
"id": "analysis-header",
"metadata": {
"papermill": {
"duration": 0.003683,
"end_time": "2026-01-18T07:16:51.749577",
"exception": false,
"start_time": "2026-01-18T07:16:51.745894",
"status": "completed"
},
"tags": []
},
"source": [
"## 6. Results Analysis"
]
},
{
"cell_type": "markdown",
"id": "257a1eaf",
"metadata": {
"tags": [
"papermill-error-cell-tag"
]
},
"source": [
"<span id=\"papermill-error-cell\" style=\"color:red; font-family:Helvetica Neue, Helvetica, Arial, sans-serif; font-size:2em;\">Execution using papermill encountered an exception here and stopped:</span>"
]
},
{
"cell_type": "code",
"execution_count": 9,
"id": "results-df",
"metadata": {
"execution": {
"iopub.execute_input": "2026-01-18T07:16:51.758547Z",
"iopub.status.busy": "2026-01-18T07:16:51.758304Z",
"iopub.status.idle": "2026-01-18T07:16:52.059151Z",
"shell.execute_reply": "2026-01-18T07:16:52.058558Z"
},
"papermill": {
"duration": 0.307111,
"end_time": "2026-01-18T07:16:52.060330",
"exception": true,
"start_time": "2026-01-18T07:16:51.753219",
"status": "failed"
},
"tags": []
},
"outputs": [
{
"ename": "ValueError",
"evalue": "Cannot describe a DataFrame without columns",
"output_type": "error",
"traceback": [
"\u001b[31m---------------------------------------------------------------------------\u001b[39m",
"\u001b[31mValueError\u001b[39m Traceback (most recent call last)",
"\u001b[36mCell\u001b[39m\u001b[36m \u001b[39m\u001b[32mIn[9]\u001b[39m\u001b[32m, line 2\u001b[39m\n\u001b[32m 1\u001b[39m df = results.get_dataframe()\n\u001b[32m----> \u001b[39m\u001b[32m2\u001b[39m \u001b[43mdf\u001b[49m\u001b[43m.\u001b[49m\u001b[43mdescribe\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\n",
"\u001b[36mFile \u001b[39m\u001b[32m~/MastersThesis/.venv/lib/python3.12/site-packages/pandas/core/generic.py:12041\u001b[39m, in \u001b[36mNDFrame.describe\u001b[39m\u001b[34m(self, percentiles, include, exclude)\u001b[39m\n\u001b[32m 11799\u001b[39m \u001b[38;5;129m@final\u001b[39m\n\u001b[32m 11800\u001b[39m \u001b[38;5;28;01mdef\u001b[39;00m\u001b[38;5;250m \u001b[39m\u001b[34mdescribe\u001b[39m(\n\u001b[32m 11801\u001b[39m \u001b[38;5;28mself\u001b[39m,\n\u001b[32m (...)\u001b[39m\u001b[32m 11804\u001b[39m exclude=\u001b[38;5;28;01mNone\u001b[39;00m,\n\u001b[32m 11805\u001b[39m ) -> Self:\n\u001b[32m 11806\u001b[39m \u001b[38;5;250m \u001b[39m\u001b[33;03m\"\"\"\u001b[39;00m\n\u001b[32m 11807\u001b[39m \u001b[33;03m Generate descriptive statistics.\u001b[39;00m\n\u001b[32m 11808\u001b[39m \n\u001b[32m (...)\u001b[39m\u001b[32m 12039\u001b[39m \u001b[33;03m max NaN 3.0\u001b[39;00m\n\u001b[32m 12040\u001b[39m \u001b[33;03m \"\"\"\u001b[39;00m\n\u001b[32m> \u001b[39m\u001b[32m12041\u001b[39m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[43mdescribe_ndframe\u001b[49m\u001b[43m(\u001b[49m\n\u001b[32m 12042\u001b[39m \u001b[43m \u001b[49m\u001b[43mobj\u001b[49m\u001b[43m=\u001b[49m\u001b[38;5;28;43mself\u001b[39;49m\u001b[43m,\u001b[49m\n\u001b[32m 12043\u001b[39m \u001b[43m \u001b[49m\u001b[43minclude\u001b[49m\u001b[43m=\u001b[49m\u001b[43minclude\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 12044\u001b[39m \u001b[43m \u001b[49m\u001b[43mexclude\u001b[49m\u001b[43m=\u001b[49m\u001b[43mexclude\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 12045\u001b[39m \u001b[43m \u001b[49m\u001b[43mpercentiles\u001b[49m\u001b[43m=\u001b[49m\u001b[43mpercentiles\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 12046\u001b[39m \u001b[43m \u001b[49m\u001b[43m)\u001b[49m.__finalize__(\u001b[38;5;28mself\u001b[39m, method=\u001b[33m\"\u001b[39m\u001b[33mdescribe\u001b[39m\u001b[33m\"\u001b[39m)\n",
"\u001b[36mFile \u001b[39m\u001b[32m~/MastersThesis/.venv/lib/python3.12/site-packages/pandas/core/methods/describe.py:91\u001b[39m, in \u001b[36mdescribe_ndframe\u001b[39m\u001b[34m(obj, include, exclude, percentiles)\u001b[39m\n\u001b[32m 87\u001b[39m describer = SeriesDescriber(\n\u001b[32m 88\u001b[39m obj=cast(\u001b[33m\"\u001b[39m\u001b[33mSeries\u001b[39m\u001b[33m\"\u001b[39m, obj),\n\u001b[32m 89\u001b[39m )\n\u001b[32m 90\u001b[39m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[32m---> \u001b[39m\u001b[32m91\u001b[39m describer = \u001b[43mDataFrameDescriber\u001b[49m\u001b[43m(\u001b[49m\n\u001b[32m 92\u001b[39m \u001b[43m \u001b[49m\u001b[43mobj\u001b[49m\u001b[43m=\u001b[49m\u001b[43mcast\u001b[49m\u001b[43m(\u001b[49m\u001b[33;43m\"\u001b[39;49m\u001b[33;43mDataFrame\u001b[39;49m\u001b[33;43m\"\u001b[39;49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mobj\u001b[49m\u001b[43m)\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 93\u001b[39m \u001b[43m \u001b[49m\u001b[43minclude\u001b[49m\u001b[43m=\u001b[49m\u001b[43minclude\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 94\u001b[39m \u001b[43m \u001b[49m\u001b[43mexclude\u001b[49m\u001b[43m=\u001b[49m\u001b[43mexclude\u001b[49m\u001b[43m,\u001b[49m\n\u001b[32m 95\u001b[39m \u001b[43m \u001b[49m\u001b[43m)\u001b[49m\n\u001b[32m 97\u001b[39m result = describer.describe(percentiles=percentiles)\n\u001b[32m 98\u001b[39m \u001b[38;5;28;01mreturn\u001b[39;00m cast(NDFrameT, result)\n",
"\u001b[36mFile \u001b[39m\u001b[32m~/MastersThesis/.venv/lib/python3.12/site-packages/pandas/core/methods/describe.py:162\u001b[39m, in \u001b[36mDataFrameDescriber.__init__\u001b[39m\u001b[34m(self, obj, include, exclude)\u001b[39m\n\u001b[32m 159\u001b[39m \u001b[38;5;28mself\u001b[39m.exclude = exclude\n\u001b[32m 161\u001b[39m \u001b[38;5;28;01mif\u001b[39;00m obj.ndim == \u001b[32m2\u001b[39m \u001b[38;5;129;01mand\u001b[39;00m obj.columns.size == \u001b[32m0\u001b[39m:\n\u001b[32m--> \u001b[39m\u001b[32m162\u001b[39m \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mValueError\u001b[39;00m(\u001b[33m\"\u001b[39m\u001b[33mCannot describe a DataFrame without columns\u001b[39m\u001b[33m\"\u001b[39m)\n\u001b[32m 164\u001b[39m \u001b[38;5;28msuper\u001b[39m().\u001b[34m__init__\u001b[39m(obj)\n",
"\u001b[31mValueError\u001b[39m: Cannot describe a DataFrame without columns"
]
}
],
2026-01-18 08:19:34 +01:00
"source": [
"df = results.get_dataframe()\n",
"df.describe()"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "save-results",
"metadata": {
"papermill": {
"duration": null,
"end_time": null,
"exception": null,
"start_time": null,
"status": "pending"
},
"tags": []
},
"outputs": [],
"source": [
"# Save results to CSV\n",
"timestamp = datetime.now().strftime(\"%Y%m%d_%H%M%S\")\n",
"filename = f\"raytune_paddle_rest_results_{timestamp}.csv\"\n",
"filepath = os.path.join(OUTPUT_FOLDER, filename)\n",
"\n",
"df.to_csv(filepath, index=False)\n",
"print(f\"Results saved: {filepath}\")"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "best-config",
"metadata": {
"papermill": {
"duration": null,
"end_time": null,
"exception": null,
"start_time": null,
"status": "pending"
},
"tags": []
},
"outputs": [],
"source": [
"# Best configuration\n",
"best = df.loc[df[\"CER\"].idxmin()]\n",
"\n",
"print(f\"Best CER: {best['CER']:.6f}\")\n",
"print(f\"Best WER: {best['WER']:.6f}\")\n",
"print(f\"\\nOptimal Configuration:\")\n",
"print(f\" textline_orientation: {best['config/textline_orientation']}\")\n",
"print(f\" use_doc_orientation_classify: {best['config/use_doc_orientation_classify']}\")\n",
"print(f\" use_doc_unwarping: {best['config/use_doc_unwarping']}\")\n",
"print(f\" text_det_thresh: {best['config/text_det_thresh']:.4f}\")\n",
"print(f\" text_det_box_thresh: {best['config/text_det_box_thresh']:.4f}\")\n",
"print(f\" text_det_unclip_ratio: {best['config/text_det_unclip_ratio']}\")\n",
"print(f\" text_rec_score_thresh: {best['config/text_rec_score_thresh']:.4f}\")"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "correlation",
"metadata": {
"papermill": {
"duration": null,
"end_time": null,
"exception": null,
"start_time": null,
"status": "pending"
},
"tags": []
},
"outputs": [],
"source": [
"# Correlation analysis\n",
"param_cols = [\n",
" \"config/text_det_thresh\",\n",
" \"config/text_det_box_thresh\",\n",
" \"config/text_det_unclip_ratio\",\n",
" \"config/text_rec_score_thresh\",\n",
"]\n",
"\n",
"corr_cer = df[param_cols + [\"CER\"]].corr()[\"CER\"].sort_values(ascending=False)\n",
"corr_wer = df[param_cols + [\"WER\"]].corr()[\"WER\"].sort_values(ascending=False)\n",
"\n",
"print(\"Correlation with CER:\")\n",
"print(corr_cer)\n",
"print(\"\\nCorrelation with WER:\")\n",
"print(corr_wer)"
]
}
],
"metadata": {
"kernelspec": {
"display_name": ".venv",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.12.3"
},
"papermill": {
"default_parameters": {},
2026-01-18 08:20:24 +01:00
"duration": 118.250198,
"end_time": "2026-01-18T07:16:57.181596",
2026-01-18 08:19:34 +01:00
"environment_variables": {},
2026-01-18 08:20:24 +01:00
"exception": true,
2026-01-18 08:19:34 +01:00
"input_path": "paddle_ocr_raytune_rest.ipynb",
"output_path": "output_raytune.ipynb",
"parameters": {},
2026-01-18 08:20:24 +01:00
"start_time": "2026-01-18T07:14:58.931398",
2026-01-18 08:19:34 +01:00
"version": "2.6.0"
}
},
"nbformat": 4,
"nbformat_minor": 5
}