[Feature] CQL compatibility with compile

[vmoens]

Stack from ghstack (oldest at bottom):

• [Feature] DT compatibility with compile #2556
• [Feature] DDPG compatibility with compile #2555
• [Feature] CROSSQ compatibility with compile #2554
• -> [Feature] CQL compatibility with compile #2553
• [Feature] A2C compatibility with compile #2464

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2553

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 5 Unrelated Failures

As of commit d062b5c with merge base 50a35f6 ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  FAILED ../../../../../../tmp/test_objectives_benchmarks.py::test_iql_speed[True-None] - torch._dynamo.exc.Unsupported: Graph break under GenericContextWrappingVariable
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  FAILED ../../../../tmp/test_objectives_benchmarks.py::test_iql_speed[True-None] - torch._dynamo.exc.Unsupported: Graph break under GenericContextWrappingVariable
• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 8e482c80b2638553de1c7aef14f130c385bce0ebaeebdae9d78a52a59f283947 /exec failed with exit code 1
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 47cad96693a9cfe701c399946eb76ae6142eec7c41fe601897fcb6366bd038b1 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  RuntimeError: Command docker exec -t f105e43e0ac5039746dfea05c282305aebb8ead0748ad73e7fc98280c732e5fb /exec failed with exit code 2
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  RuntimeError: Command docker exec -t 7531851349b6c97271a44d59ffe7e8bbe59116b6eef433a87e5d2a30072116d1 /exec failed with exit code 2
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 90db01be7b89e89fa342ad430cf262495a3304be0676c78e319eab00b45532d2 /exec failed with exit code 2
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  RuntimeError: Command docker exec -t 2ea38d795a0107f3d1efaf692940704383371a52c2e5d154761a27b13c092a9d /exec failed with exit code 2
• Unit-tests on Linux / tests-cpu-oldget (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 90bdfdac1f25326aa28b9e0a4a56e8f623425a06646f8bff875d4c69bb37bd92 /exec failed with exit code 2
• Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 0195ff4a407c435b15947584706ecc360012ae6f66697a3ce129adbe5cde80e2 /exec failed with exit code 2
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t b23f2dee4041814c730ee831feaefe72aa85656ed0c6cbad167e9f1e8f4ce149 /exec failed with exit code 2
• Unit-tests on Linux / tests-optdeps (3.11, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 600d8b1f36033bc50a50980da99d74d021244eb9f8967ffc24beba2d08143139 /exec failed with exit code 2
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 7e730cbc5e9c5e56d10335699bfed7e30abf7665e577c535fb59241e2c715178 /exec failed with exit code 2

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_1 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  ##[error]Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.