Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New mvaTTH weights for Run 3 #46492

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

Cvico
Copy link
Contributor

@Cvico Cvico commented Oct 23, 2024

PR description:

Brief description

Dear reviewers,

This PR is to introduce the newest training of the Electron mvaTTH in CMSSW. The training has been performed following what was done already done for Run 2, but using Run 3 MC samples for training and validation.

Context of the PR

The goal for this new training is to be used as a substitute of the current mvaTTH only in Run 3 MC production. That is: for Run 2 we still need to keep the current mvaTTH implementation.

What this PR includes

This change should only affect Run 3 production. How the mva is evaluated changes a little bit with respect to the previous version: mainly the order in which the variables are parsed to TMVA and also we have added a new additional variable which is LepGood_pfRelIso03_all.

IMPORTANT REMARK

The training has been done considering a MiniAOD that has a buggy mvaNoISO variable. Instead of considering the buggy variable, the training has been done with mvaISO (and so it reflects in the config file, the last input variable to the MVA is mvaISO). This will change in the future most likely.

Validation

I've performed a local test running a simple cmsRun script to see that the mva is loaded and nanoAOD is in fact produced. Below is the cmsDriver I've used (in a cmssw-el8 container):

cmsDriver.py --python_filename GEN-Run3Summer23NanoAODv12-00146_1_cfg.py --eventcontent NANOEDMAODSIM --customise Configuration/DataProcessing/Utils.addMonitoring --datatier NANOAODSIM --fileout file:GEN-Run3Summer23NanoAODv12-00146.root --conditions 130X_mcRun3_2023_realistic_v14 --step NANO --scenario pp --filein "dbs:/WZto3LNu_TuneCP5_13p6TeV_powheg-pythia8/Run3Summer23MiniAODv4-130X_mcRun3_2023_realistic_v14-v1/MINIAODSIM" --era Run3_2023 --no_exec --mc -n 1
Below there's also a plot comparing the performance of this training vs the current one.
image

Other comments

Please let me know if the proposal is reasonable, and if there's anything else I can do for testing. I'm adding the L2 electron conveners @RSalvatico @afiqaize so they can follow up the PR as well. Feel free to add any other electron convener. I'm also tagging the placeholder PR that Riccardo prepare in the links below (I prefered creating a new one).

Linked PRs

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 23, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46492/42348

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @Cvico for master.

It involves the following packages:

  • PhysicsTools/NanoAOD (xpog)

@cmsbuild, @ftorrresd, @hqucms can you please review it and eventually sign? Thanks.
@AnnikaStein, @gpetruc this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@RSalvatico
Copy link
Contributor

type egamma

@RSalvatico
Copy link
Contributor

enable nano

@RSalvatico
Copy link
Contributor

@cmsbuild, please test

@hqucms
Copy link
Contributor

hqucms commented Oct 23, 2024

please abort

@hqucms
Copy link
Contributor

hqucms commented Oct 23, 2024

test parameters:

variables = _legacy_electron_BDT_variable
)

(run2_egamma_2016 | run2_egamma_2018).toModify(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Cvico I think it should be run2_egamma_2017 instead of run2_egamma_2016?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @hqucms. You are right, I've just pushed the fix. Thanks!

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Pull request #46492 was updated. @cmsbuild, @ftorrresd, @hqucms can you please check and sign again.

@hqucms
Copy link
Contributor

hqucms commented Oct 24, 2024

please test

@cmsbuild
Copy link
Contributor

-1

Failed Tests: RelVals RelVals-INPUT RelVals-NANO
Size: This PR adds an extra 24KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9d39be/42371/summary.html
COMMIT: 3bf68e7
CMSSW: CMSSW_14_2_X_2024-10-23-2300/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46492/42371/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

----- Begin Fatal Exception 24-Oct-2024 13:19:53 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Processing  Event run: 356381 lumi: 67 event: 55598608 stream: 0
   [1] Running path 'dqmoffline_1_step'
   [2] Prefetching for module NanoAODDQM/'nanoDQM'
   [3] Prefetching for module SimplePATElectronFlatTableProducer/'electronTable'
   [4] Calling method for module EleBaseMVAValueMapProducer/'electronPROMPTMVA'
Exception Message:
A std::exception was thrown.
no method or data member named "pfIsolationR03" found for type "pat::Electron"
It has the following methods
 superCluster
 gsfTrack
 passConversionVeto
 Electron
 Electron
 Electron
 Electron
 ~Electron
 clone
 core
 parentSuperCluster
 track
 closestCtfTrackRef
 seed
 basicClusters
 preshowerClusters
 pflowBasicClusters
 pflowPreshowerClusters
 track
 embedGsfElectronCore
 embedGsfTrack
 embedSuperCluster
 embedPflowSuperCluster
 embedSeedCluster
 embedBasicClusters
 embedPreshowerClusters
 embedPflowBasicClusters
 embedPflowPreshowerClusters
 embedTrack
 embedRecHits
 electronID
 electronID
 isElectronIDAvailable
 isElectronIDAvailable
 electronIDs
 setElectronIDs
 trackIso
 ecalIso
 hcalIso
 caloIso
 puppiChargedHadronIso
 puppiNeutralHadronIso
 puppiPhotonIso
 puppiNoLeptonsChargedHadronIso
 puppiNoLeptonsNeutralHadronIso
 puppiNoLeptonsPhotonIso
 setIsolationPUPPI
 setIsolationPUPPINoLeptons
 isPF
 setIsPF
 pfCandidateRef
 setPFCandidateRef
 embedPFCandidate
 numberOfSourceCandidatePtrs
 sourceCandidatePtr
 dB
 edB
 dB
 edB
 setDB
 ecalDrivenMomentum
 setEcalDrivenMomentum
 sigmaIetaIphi
 full5x5_sigmaIetaIphi
 ip3d
 setMvaVariables
 full5x5_setSigmaIetaIphi
 recHits
 ecalRegressionEnergy
 ecalRegressionError
 ecalTrackRegressionEnergy
 ecalTrackRegressionError
 setEcalRegressionEnergy
 setEcalTrackRegressionEnergy
 setEcalScale
 setEcalSmear
 setEcalRegressionScale
 setEcalRegressionSmear
 setEcalTrackRegressionScale
 setEcalTrackRegressionSmear
 ecalScale
 ecalSmear
 ecalRegressionScale
 ecalRegressionSmear
 ecalTrackRegressionScale
 ecalTrackRegressionSmear
 setPassConversionVeto
 associatedPackedPFCandidates
 initImpactParameters
 Electron
 operator=
and the following data members
 embeddedGsfElectronCore_
 gsfElectronCore_
 embeddedGsfTrack_
 gsfTrack_
 embeddedSuperCluster_
 embeddedPflowSuperCluster_
 superCluster_
 superClusterRelinked_
 basicClusters_
 preshowerClusters_
 pflowBasicClusters_
 pflowPreshowerClusters_
 pflowSuperCluster_
 embeddedTrack_
 track_
 embeddedSeedCluster_
 seedCluster_
 embeddedRecHits_
 recHits_
 electronIDs_
 isPF_
 embeddedPFCandidate_
 pfCandidate_
 pfCandidateRef_
 ecalDrivenMomentum_
 sigmaIetaIphi_
 full5x5_sigmaIetaIphi_
 ip3d_
 ecalRegressionEnergy_
 ecalTrackRegressionEnergy_
 ecalRegressionError_
 ecalTrackRegressionError_
 ecalScale_
 ecalSmear_
 ecalRegressionScale_
 ecalRegressionSmear_
 ecalTrackRegressionScale_
 ecalTrackRegressionSmear_
 puppiChargedHadronIso_
 puppiNeutralHadronIso_
 puppiPhotonIso_
 puppiNoLeptonsChargedHadronIso_
 puppiNoLeptonsNeutralHadronIso_
 puppiNoLeptonsPhotonIso_
 passConversionVeto_
 cachedIP_
 ip_
 eip_
 packedPFCandidates_
 associatedPackedFCandidateIndices_
 PV2D
 PV3D
 BS2D
 BS3D
 PVDZ
 IpTypeSize
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 24-Oct-2024 13:19:56 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Processing  Event run: 355769 lumi: 37 event: 23965217 stream: 0
   [1] Running path 'dqmoffline_1_step'
   [2] Prefetching for module NanoAODDQM/'nanoDQM'
   [3] Prefetching for module SimplePATElectronFlatTableProducer/'electronTable'
   [4] Calling method for module EleBaseMVAValueMapProducer/'electronPROMPTMVA'
Exception Message:
A std::exception was thrown.
no method or data member named "pfIsolationR03" found for type "pat::Electron"
It has the following methods
 superCluster
 gsfTrack
 passConversionVeto
 Electron
 Electron
 Electron
 Electron
 ~Electron
 clone
 core
 parentSuperCluster
 track
 closestCtfTrackRef
 seed
 basicClusters
 preshowerClusters
 pflowBasicClusters
 pflowPreshowerClusters
 track
 embedGsfElectronCore
 embedGsfTrack
 embedSuperCluster
 embedPflowSuperCluster
 embedSeedCluster
 embedBasicClusters
 embedPreshowerClusters
 embedPflowBasicClusters
 embedPflowPreshowerClusters
 embedTrack
 embedRecHits
 electronID
 electronID
 isElectronIDAvailable
 isElectronIDAvailable
 electronIDs
 setElectronIDs
 trackIso
 ecalIso
 hcalIso
 caloIso
 puppiChargedHadronIso
 puppiNeutralHadronIso
 puppiPhotonIso
 puppiNoLeptonsChargedHadronIso
 puppiNoLeptonsNeutralHadronIso
 puppiNoLeptonsPhotonIso
 setIsolationPUPPI
 setIsolationPUPPINoLeptons
 isPF
 setIsPF
 pfCandidateRef
 setPFCandidateRef
 embedPFCandidate
 numberOfSourceCandidatePtrs
 sourceCandidatePtr
 dB
 edB
 dB
 edB
 setDB
 ecalDrivenMomentum
 setEcalDrivenMomentum
 sigmaIetaIphi
 full5x5_sigmaIetaIphi
 ip3d
 setMvaVariables
 full5x5_setSigmaIetaIphi
 recHits
 ecalRegressionEnergy
 ecalRegressionError
 ecalTrackRegressionEnergy
 ecalTrackRegressionError
 setEcalRegressionEnergy
 setEcalTrackRegressionEnergy
 setEcalScale
 setEcalSmear
 setEcalRegressionScale
 setEcalRegressionSmear
 setEcalTrackRegressionScale
 setEcalTrackRegressionSmear
 ecalScale
 ecalSmear
 ecalRegressionScale
 ecalRegressionSmear
 ecalTrackRegressionScale
 ecalTrackRegressionSmear
 setPassConversionVeto
 associatedPackedPFCandidates
 initImpactParameters
 Electron
 operator=
and the following data members
 embeddedGsfElectronCore_
 gsfElectronCore_
 embeddedGsfTrack_
 gsfTrack_
 embeddedSuperCluster_
 embeddedPflowSuperCluster_
 superCluster_
 superClusterRelinked_
 basicClusters_
 preshowerClusters_
 pflowBasicClusters_
 pflowPreshowerClusters_
 pflowSuperCluster_
 embeddedTrack_
 track_
 embeddedSeedCluster_
 seedCluster_
 embeddedRecHits_
 recHits_
 electronIDs_
 isPF_
 embeddedPFCandidate_
 pfCandidate_
 pfCandidateRef_
 ecalDrivenMomentum_
 sigmaIetaIphi_
 full5x5_sigmaIetaIphi_
 ip3d_
 ecalRegressionEnergy_
 ecalTrackRegressionEnergy_
 ecalRegressionError_
 ecalTrackRegressionError_
 ecalScale_
 ecalSmear_
 ecalRegressionScale_
 ecalRegressionSmear_
 ecalTrackRegressionScale_
 ecalTrackRegressionSmear_
 puppiChargedHadronIso_
 puppiNeutralHadronIso_
 puppiPhotonIso_
 puppiNoLeptonsChargedHadronIso_
 puppiNoLeptonsNeutralHadronIso_
 puppiNoLeptonsPhotonIso_
 passConversionVeto_
 cachedIP_
 ip_
 eip_
 packedPFCandidates_
 associatedPackedFCandidateIndices_
 PV2D
 PV3D
 BS2D
 BS3D
 PVDZ
 IpTypeSize
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 24-Oct-2024 13:26:33 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Processing  Event run: 369978 lumi: 547 event: 626453380 stream: 0
   [1] Running path 'dqmoffline_1_step'
   [2] Prefetching for module NanoAODDQM/'nanoDQM'
   [3] Prefetching for module SimplePATElectronFlatTableProducer/'electronTable'
   [4] Calling method for module EleBaseMVAValueMapProducer/'electronPROMPTMVA'
Exception Message:
A std::exception was thrown.
no method or data member named "pfIsolationR03" found for type "pat::Electron"
It has the following methods
 superCluster
 gsfTrack
 passConversionVeto
 Electron
 Electron
 Electron
 Electron
 ~Electron
 clone
 core
 parentSuperCluster
 track
 closestCtfTrackRef
 seed
 basicClusters
 preshowerClusters
 pflowBasicClusters
 pflowPreshowerClusters
 track
 embedGsfElectronCore
 embedGsfTrack
 embedSuperCluster
 embedPflowSuperCluster
 embedSeedCluster
 embedBasicClusters
 embedPreshowerClusters
 embedPflowBasicClusters
 embedPflowPreshowerClusters
 embedTrack
 embedRecHits
 electronID
 electronID
 isElectronIDAvailable
 isElectronIDAvailable
 electronIDs
 setElectronIDs
 trackIso
 ecalIso
 hcalIso
 caloIso
 puppiChargedHadronIso
 puppiNeutralHadronIso
 puppiPhotonIso
 puppiNoLeptonsChargedHadronIso
 puppiNoLeptonsNeutralHadronIso
 puppiNoLeptonsPhotonIso
 setIsolationPUPPI
 setIsolationPUPPINoLeptons
 isPF
 setIsPF
 pfCandidateRef
 setPFCandidateRef
 embedPFCandidate
 numberOfSourceCandidatePtrs
 sourceCandidatePtr
 dB
 edB
 dB
 edB
 setDB
 ecalDrivenMomentum
 setEcalDrivenMomentum
 sigmaIetaIphi
 full5x5_sigmaIetaIphi
 ip3d
 setMvaVariables
 full5x5_setSigmaIetaIphi
 recHits
 ecalRegressionEnergy
 ecalRegressionError
 ecalTrackRegressionEnergy
 ecalTrackRegressionError
 setEcalRegressionEnergy
 setEcalTrackRegressionEnergy
 setEcalScale
 setEcalSmear
 setEcalRegressionScale
 setEcalRegressionSmear
 setEcalTrackRegressionScale
 setEcalTrackRegressionSmear
 ecalScale
 ecalSmear
 ecalRegressionScale
 ecalRegressionSmear
 ecalTrackRegressionScale
 ecalTrackRegressionSmear
 setPassConversionVeto
 associatedPackedPFCandidates
 initImpactParameters
 Electron
 operator=
and the following data members
 embeddedGsfElectronCore_
 gsfElectronCore_
 embeddedGsfTrack_
 gsfTrack_
 embeddedSuperCluster_
 embeddedPflowSuperCluster_
 superCluster_
 superClusterRelinked_
 basicClusters_
 preshowerClusters_
 pflowBasicClusters_
 pflowPreshowerClusters_
 pflowSuperCluster_
 embeddedTrack_
 track_
 embeddedSeedCluster_
 seedCluster_
 embeddedRecHits_
 recHits_
 electronIDs_
 isPF_
 embeddedPFCandidate_
 pfCandidate_
 pfCandidateRef_
 ecalDrivenMomentum_
 sigmaIetaIphi_
 full5x5_sigmaIetaIphi_
 ip3d_
 ecalRegressionEnergy_
 ecalTrackRegressionEnergy_
 ecalRegressionError_
 ecalTrackRegressionError_
 ecalScale_
 ecalSmear_
 ecalRegressionScale_
 ecalRegressionSmear_
 ecalTrackRegressionScale_
 ecalTrackRegressionSmear_
 puppiChargedHadronIso_
 puppiNeutralHadronIso_
 puppiPhotonIso_
 puppiNoLeptonsChargedHadronIso_
 puppiNoLeptonsNeutralHadronIso_
 puppiNoLeptonsPhotonIso_
 passConversionVeto_
 cachedIP_
 ip_
 eip_
 packedPFCandidates_
 associatedPackedFCandidateIndices_
 PV2D
 PV3D
 BS2D
 BS3D
 PVDZ
 IpTypeSize
----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

RelVals-INPUT

  • 2500.1112500.111_NANOdata130Xrun3/step2_NANOdata130Xrun3.log
  • 2500.1012500.101_NANOmc130X/step2_NANOmc130X.log
  • 2500.1122500.112_NANOdata130Xrun3/step2_NANOdata130Xrun3.log
Expand to see more relval errors ...

RelVals-NANO

  • 2500.1112500.111_NANOdata130Xrun3/step2_NANOdata130Xrun3.log
  • 2500.1012500.101_NANOmc130X/step2_NANOmc130X.log
  • 2500.1122500.112_NANOdata130Xrun3/step2_NANOdata130Xrun3.log
Expand to see more relval errors ...

@Cvico
Copy link
Contributor Author

Cvico commented Oct 24, 2024

Hi, sorry for delayed action, I'm at a conference. I think the issue above was due to a wrong call to pfRelIso03 variable (which is new in the training). I've taken the correct definition from the config file. This is now in line with what I use to train.

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Pull request #46492 was updated. @cmsbuild, @ftorrresd, @hqucms can you please check and sign again.

@hqucms
Copy link
Contributor

hqucms commented Oct 24, 2024

please test

@cmsbuild
Copy link
Contributor

+1

Size: This PR adds an extra 24KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9d39be/42383/summary.html
COMMIT: 04558a1
CMSSW: CMSSW_14_2_X_2024-10-24-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46492/42383/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

NANO Comparison Summary

Summary:

Nano size comparison Summary:

Sample kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
2500.001 3.000 3.000 0.000 ( +0.0% ) 2.96 2.99 -1.2% 2.359 2.362
2500.002 3.110 3.110 0.000 ( +0.0% ) 2.62 2.65 -1.4% 2.791 2.788
2500.003 3.054 3.054 0.000 ( +0.0% ) 2.75 2.79 -1.2% 2.797 2.781
2500.011 1.575 1.575 0.000 ( +0.0% ) 4.61 4.69 -1.7% 2.459 2.462
2500.012 2.093 2.093 0.000 ( +0.0% ) 2.78 2.82 -1.5% 2.647 2.643
2500.013 1.917 1.917 0.000 ( +0.0% ) 3.97 4.00 -0.9% 2.553 2.550
2500.021 0.022 0.022 0.000 ( +0.0% ) 0.90 0.92 -1.9% 2.421 2.415
2500.022 0.022 0.022 0.000 ( +0.0% ) 0.87 0.91 -4.0% 2.415 2.422
2500.023 0.022 0.022 0.000 ( +0.0% ) 0.85 0.90 -5.7% 2.276 2.285
2500.024 0.022 0.022 0.000 ( +0.0% ) 0.65 0.69 -5.3% 2.506 2.501
2500.031 0.035 0.035 0.000 ( +0.0% ) 0.80 0.84 -4.9% 2.482 2.489
2500.032 0.036 0.036 0.000 ( +0.0% ) 0.80 0.85 -5.9% 2.450 2.444
2500.033 0.037 0.037 -0.000 ( -0.1% ) 0.74 0.77 -3.8% 2.527 2.528
2500.034 0.036 0.036 0.000 ( +0.0% ) 0.73 0.78 -6.2% 2.513 2.513
2500.101 2.753 2.753 -0.000 ( -0.0% ) 7.39 7.72 -4.3% 2.603 2.596
2500.111 1.399 1.399 -0.000 ( -0.0% ) 16.98 17.42 -2.6% 2.298 2.299
2500.112 1.818 1.818 -0.000 ( -0.0% ) 13.89 14.19 -2.1% 2.381 2.377
2500.131 0.747 0.747 0.000 ( +0.0% ) 17.71 18.34 -3.4% 1.524 1.521
2500.201 2.582 2.582 -0.000 ( -0.0% ) 6.23 6.47 -3.6% 2.167 2.158
2500.211 1.736 1.736 -0.000 ( -0.0% ) 14.89 15.35 -3.0% 2.369 2.370
2500.212 2.131 2.131 0.000 ( +0.0% ) 12.31 12.50 -1.5% 2.451 2.450
2500.221 2.003 2.003 0.000 ( +0.0% ) 6.57 6.77 -2.9% 2.086 2.082
2500.222 3.378 3.378 -0.000 ( -0.0% ) 6.15 6.31 -2.6% 2.170 2.168
2500.223 9.343 9.343 -0.000 ( -0.0% ) 1.82 1.83 -0.9% 2.248 2.238
2500.224 6.026 6.026 -0.000 ( -0.0% ) 0.59 0.59 -0.5% 2.237 2.225
2500.225 6.058 6.058 -0.000 ( -0.0% ) 0.56 0.57 -1.7% 2.311 2.307
2500.226 3.072 3.072 -0.000 ( -0.0% ) 6.33 6.46 -2.1% 2.172 2.163
2500.227 1.437 1.437 0.000 ( +0.0% ) 11.57 11.96 -3.3% 1.433 1.425
2500.231 1.408 1.408 0.000 ( +0.0% ) 12.25 12.64 -3.0% 2.271 2.262
2500.232 2.390 2.390 -0.000 ( -0.0% ) 11.37 11.79 -3.6% 2.364 2.368
2500.233 4.882 4.882 0.000 ( +0.0% ) 2.71 2.80 -3.5% 2.433 2.423
2500.234 3.648 3.648 0.000 ( +0.0% ) 0.75 0.76 -1.1% 2.405 2.396
2500.235 3.667 3.667 0.000 ( +0.0% ) 0.72 0.73 -1.5% 2.460 2.450
2500.236 2.180 2.180 0.000 ( +0.0% ) 11.94 12.54 -4.8% 2.358 2.359
2500.237 1.016 1.016 0.000 ( +0.0% ) 17.00 17.27 -1.6% 1.472 1.471
2500.241 9.404 9.404 0.000 ( +0.0% ) 3.63 3.71 -2.2% 1.926 1.926
2500.242 10.331 10.331 0.000 ( +0.0% ) 0.87 0.92 -5.2% 1.710 1.714
2500.243 2.712 2.712 0.000 ( +0.0% ) 8.41 8.38 +0.4% 1.076 1.080
2500.244 485.976 485.976 0.000 ( +0.0% ) 0.55 0.57 -4.6% 1.669 1.678
2500.245 823.202 823.202 0.000 ( +0.0% ) 0.72 0.75 -3.3% 1.664 1.667
2500.901 1.777 1.777 0.000 ( +0.0% ) 20.87 21.78 -4.2% 1.420 1.424
2500.902 1.626 1.626 0.000 ( +0.0% ) 21.47 21.84 -1.7% 1.326 1.328
2500.911 13.995 13.995 0.000 ( +0.0% ) 1.81 3.47 -47.9% 1.095 1.094
2500.912 0.199 0.310 -0.111 ( -35.7% ) 1.22 1.00 +21.8% 0.980 0.981
2500.913 0.110 0.110 0.000 ( +0.0% ) 1.11 1.09 +2.1% 0.983 0.979

@hqucms
Copy link
Contributor

hqucms commented Oct 24, 2024

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @mandrenguyen, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)
Notice This PR was tested with additional Pull Request(s), please also merge them if necessary: cms-data/PhysicsTools-NanoAOD#19

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants