-
Notifications
You must be signed in to change notification settings - Fork 56
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Decision Proposal 361 - Energy LCCD Phase 2 #361
Comments
Good work, guys. 👍 QQ - if there a particular reason the |
@mattyp the optional fields in the standards must to be shared if the DH holds the value. See "Mandatory/Optional Fields" in Payload Conventions. In other words, they are conditional to the data being held. In other words, if the lastConsumerChangeDate is available for a given NMI/Service Point, it must be shared. Hope this clarifies. |
Ah, yes, thanks for the reminder 😝. So, does that mean that some retailers may not have access to the LCCD to populate |
@mattyp, below are few points which further clarifiy the proposal of making the lastConsumerChangeDate field optional:
|
Thanks, @HemangCDR. It's good to have these points available for all to find 👍. So, by virtue of the DH architecture coupled with the definition of |
LCCD is an exciting step forward! Thanks Hemang and team. I would second mattyp's point about optional fields being a bit of a thorn for ADRs. Constantly having to check if certain fields exist adds to the complexity of understanding if no data in a response was intended or is a legitimate issue that needs to be flagged. On many occasions we at SolvingZero have had to follow up through the various channels to figure out if the missing field is a legitimate issue or the case of an optional field not present. Primarly because, we feel, DHs will use optional fields very liberally. As one example, DHs will populate optional fields with data that is effectively the same as it not existing, eg end_date can be in the year 9999 or not exist, both imply the date is basically infinite. In these cases the optional fields are providing too much wiggle room and the data quality suffers as a result. Getting back to LCCD. Adjacent to LCCD, being able to track the energy tariffs a customer had during their historical usage across multiple DHs would be a significant benefit to ADRs and the end consumer. This will allow for the usage to be translated into dollar values (costs), which by and far is the preferred unit of measure for consumers, rather than kWh or some other energy-based measure of units. Perhaps this is out of the scope of LCCD, but this would be a huge next step to build upon the work of LCCD for the benefit of the consumer. |
Sounds like a good suggestion, worthy of its own maintenance issue, @Sbendat 👍. Another use-case for that data would be to know if a consumer is eligible for a tariff change (under the standard one tariff change per year DNSP rule). I can outline that against the dedicated maintenance issue. |
Hi Team, to what extent does the data request predate the LCCD? Are there guidelines for a fixed duration? % of historic data available? other? |
@TaylorWoods1 the rules limit the sharing of historical energy usage/metering data to a maximum of 2 years from the date of request. |
Thanks Hemang, To confirm, is the intent of the 2-year data-sharing rule to provide all available usage data from the smart meter for the past 2 years, regardless of the customer’s tenure with their current retailer? For example, if a customer has had a smart meter for 2 years but has only been with the current retailer for one week, would they still receive the full 2 years of data upon providing consent? Regards, Taylor |
Hi @HemangCDR , AGL is currently in the process of reviewing the Decision Proposal 361 in detail. To determine whether we may need to provide further feedback to this consultation, we are seeking the DSB's clarification as to:
However, Part 3.2 Clause (7) of the Competition and Consumer (Consumer Data Right Rules) 2020 specifies that: (a) CDR data held by AEMO, other than metering data; AGL is seeking clarification as to whether the DSB believes that the Decision Proposal 361 is compatible with the provisions above, or whether it anticipates that Treasury will seek changes to the legislation to facilitate these new changes. |
@TaylorWoods1 yes this is the intent. @AGL-ENERGY-CDR, I've tried to respond to your questions below:
I don't fully understand the question. We don’t anticipate any changes to how participant ID will be used. Our understanding is it is used by AEMO for authenticating retailers and will continue to be so. Does this address your query?
It is not clear if the question is for data holders or data recipients accessing AEMO payload? The ADR's would set the oldest-date to the value they want the usage data to go back to. The DH (Retailer) would (assuming its for an existing open account), would send it to AEMO as is. AEMO would use that date and apply various checks to determine how much historical data to share. One of the checks would be LCCD as being proposed by this paper.
As noted in the DP, we do not anticipate any impacts on how data is shared for closed accounts. The data sharing for closed accounts would continue as it presently occurs – being limited to the duration the retailer was the FRMP for the NMI. This would require the retailer to ensure the request range for closed accounts is limited to how long the customer was their account holder for the NMI.
We do not believe the proposed changes have any conflict with data sharing requirements for closed accounts. As noted above, sharing of usage data for closed accounts will continue as it presently occurs, limited to the duration the retailer was the FRMP for the account. Hope the above clarifies. |
AEMO thanks DSB for the opportunity to comment on the above Decision Proposal. We take this opportunity to request an extension of the feedback period of at least one week to allow our development staff who are on leave, to return and confirm our ability to meet our proposed FDO of November or if it needs to be later. Our initial feedback is enclosed in the following pdf and includes a tentative proposed FDO of November 2025 which is to be confirmed or modified and appended to this feedback. We welcome any further feedback or discussion. |
@johnAEMO , thank you for your feedback. We will extend the consultation period till next Friday the 7th of February as per AEMO's request to confirm the FDO dates. |
Hi, On behalf of EnergyAustralia: We note an issue with Decision Proposal 361 which does not appear to have been contemplated and would result in unintended outcomes. The issue is a consequence of the following factors:
To resolve the issue, we recommend that the implementation date of the Decision Proposal be aligned to retain at least two years from the date the LCCD flag commenced i.e. 1 November 2025. This would mean the issue does not result as AEMO data sharing of historical usage data would be capped at two years, and not send data prior to 1 November 2023. We’d welcome a discussion if more explanation is required. |
Hi, EnergyAustralia also has a comment in response to:
At first glance historical energy tariffs (which match the period that historical usage data is provided under LCCD) does sound helpful and we generally agree that expressing unit of measure in dollar value is more meaningful to the customer. However, when unpacking this proposal against use cases, we question the utility of this proposal in practice. We note that use cases will involve comparing a customer's current pricing/tariffs against new product pricing, and that this comparison will be forward looking rather than historical. To do this, the key information is the customer's current pricing/tariffs and the best prediction of their usage (which is historical usage data). That is, current tariff rather than historical tariff information is the most relevant input. Further, we also note that the current retailer through which historical usage data will be provided (using the LCCD field), will not have historical tariff information to match this data. Rather this information will be held by the previous retailer. This would require significant changes to the CDR to access this information, with the simplest and most appropriate solution being that the data be provided by the previous retailer (to avoid sharing of tariff information between competitors). This then raises the question why the previous retailer is not also providing the historical usage data which the LCCD change was built to facilitate. Very happy to unpack this issue more with the DSB and others. Thank you |
@SelenaLiuEA point of clarification here:
Because the retailer isn’t considered the Holder of usage data in ANY circumstance, this is AEMO as the Secondary Data Holder, the Retailers have an obligation to pass this through unaltered and it is non-compliant to do otherwise. |
My 2 cents on this DP and the related conversation. On the proposal itself On the
Regarding AEMO's feedback
On the FDO date
On Closed accounts Based on the above I recommend only one change which is to modify the standards language to facilitate closed accounts as follows: If the request is for historical usage data, then:
|
Just to clarify *>
Thanks James, it won't be universally populated, but the two year limit means at least the blanks and LCCD dates that are actually in MSATS will be correct (assuming AEMO only has to share historical usage data up to two years) |
Agree, loose language. I mean it raises the question why the previous retailer isn't facilitating the provision of historical usage data (via the customer authenticating, authorising through them as opposed to the current retailer) |
Great discussion Closed accounts and access to historical usage data. Can I attempt to flesh out an underlying question that seems to have arisen and is perhaps unclear as to the intended position? AEMO has (possibly incorrectly) defined a "closed account" from an energy perspective as any account relating to the NMI where the retailer is no longer the FRMP. Any closed account retailer will get only the usage data for the period they were the FRMP for that NMI - as now, so there is no change. This is independent of when any LCCD falls. I get the impression that there are different expectations as to the ability of a past retailer to gain access to historical usage data, depending on if their period as FRMP was more recent than the LCCD or earlier than the LCCD. AEMO's preference is to treat these as the same - both as "closed accounts" and both only get the usage data for the period they were FRMP (as now). Our position is that only the current FRMP is the Primary Data Holder and has access to all historical usage data from now back to the LCCD (if present). On LCCD not populated On errors for closed account requests spanning an LCCD AEMO would be interested in any further discussion on these points. |
Responding to @johnAEMO...
A closed account means a previous customer holding the NMI. It doesn't mean the FRMP has changed. If I sell my house and the new owner stays with the same retailer then the LCCD is set but the FRMP doesn't change. If I access my usage then I will only be able to get my data as a "closed account" request and only for a period prior to the LCCD. It will be the current FRMP though. This is why I have suggested that any usage request for a range prior to the LCCD should be limited to the period where the requesting retailer was the owning FRMP (which is the current case). I think this aligns with what you're saying John but correct me if I'm wrong. At the risk of being a pedant, the Primary Data Holder is an CDR definition (ie. they are the one receiving the call which they then pass on to the Secondary Data Holder), but they don't have to be the current FRMP. It is true that they are usually the same but this is not necessarily true in all instances (for example, the case of closed accounts). The term Primary Data Holder and the term "current FRMP" are therefore not equal.
That makes sense and clarifies the AEMO feedback. That is essentially what I was saying. If the LCCD isn't populated it just means an indeterminate time in the past (probably before the field went live).
What I would suggest is that, if the request range covers an LCCD date then the request should be truncated to the LCCD date even if the range is entirely in the period covered by the current FRMP. That covers the risk you are describing and would be simpler to implement as it is the same logic for if the range covers multiple FRMPs. This scenario would only occur if the current retailer made a mistake - either on the API call or in setting the LCCD - so I believe this would be the conservative way to handle this edge case. |
Question from our developers who are sizing the effort for LCCD: |
This is why I have suggested that any usage request for a range prior to the LCCD should be limited to the period where the requesting retailer was the owning FRMP (which is the current case). I think this aligns with what you're saying John but correct me if I'm wrong. Agreed on the first point that if the retailer remains FRMP following a move out/move in the account will be a "closed account". On the second point, if the requesting retailer is not currently FRMP would this still return an error from the Get Services call following the introduction of the LCCD? Meaning that "closed accounts" would only be returned if the requesting retailer remains FRMP following an LCCD update. Based on this logic could we see the edge case where the LCCD is changed multiple times within a two-year period, the same retailer remains FRMP, and as a result shares usage data from the latest LCCD update, spanning the now multiple customer's usage periods and risking a privacy issue? Or is there an existing part of the process that would stop this? @johnAEMO with the non-populated LCCD did all retailers go live with the LCCD process on November 1st 2023, could this be a risk making the assumption all retailers commenced populating the LCCD from November 1st? |
|
Thank you all for the opportunity to discuss LCCD and provide feedback on Decision Proposal 361. AGL agrees with James’ recommendation above that the standards language will need to be in updated to account for “LCCD truncation which only occurs when the LCCD date falls within the requested period”. However, there are two other scenarios that will need to be explicitly catered for, specifically, in circumstances where the LCCD request falls wholly before of the period request and where it falls wholly ahead of the period request to provide clarity around expectations. For example: Under Section 1. Update Shared Responsibility, replace the current text with:
AEMO MUST limit the period of historical usage data returned to the period dating back to (and inclusive of) the LCCD…,” and so forth.
(the DSB and AEMO may need to determine the appropriate actions for AEMO to take in this scenario, as they may be different to the requirements under 1, above).
the DSB and AEMO may need to determine the appropriate actions for AEMO to take in this scenario, as they may be different to the requirements under 1 and 2, above). Benefit analysis AGL notes that a risk and benefits analysis was performed as a part of the consultation process. As of 21 January 2025, only 18% of NMIs had the LCCD field populated since inception in November 2023. This raises the question as to whether the DSB should pause these reforms until a higher penetration of LCCD data is available in the market, and a greater uptake of energy CDR. Complaint Handling AGL is also seeking further clarification as to how the complaints management process is expected to be handled in this context. For example, if another retailer was FRMP up until 12/12/2024 but the LCCD was not populated and customer churned to AGL on the 13/12/2024, they would only be able to access historical usage data from the 13/12/2024. If the customer or their representative complains about not seeing historical data before this date, AGL would have limited avenues to resolve the issue as we do not have visibility of the LCCD in MSATs prior to this. |
AEMO thanks DSB for the extension to the deadline for this consultation which has allowed our developers sufficient time to confirm at a high level, their ability to meet an FDO of no earlier than November 2025. |
Feedback for this consultation has closed. Thank you to everyone who contributed. Feedback will be reviewed and responded to before a data standard is made by the Chair. |
Thank you everyone for your contributions to this consultation. The DSB have reviewed the feedback and acknowledge broad support for the change proceeding. Below are responses to feedback on the consultation: lastConsumerChangeDate field
FDO
Sharing of historical usage data, error code and closed accounts
If the request is for electricity usage data, then:
It has been amended based on the feedback to:
The DSB will also publish guidance article further clarifying the conditions and obligations on retailers and AEMO for usage data requests with LCCD. Benefits
Complaints management
The proposal with the above noted amendments will be put to the Chair for review and approval. |
The comment has been updated with the final proposed standards language to be used in the Shared Responsibility->Additional Requirements section. |
Decision 361 has been approved by the Data Standards Chair: These changes will be incorporated into v1.34.0 of the Standards. |
Update: February 7th, 2025
Feedback for this consultation has closed. Thank you to everyone who contributed. Feedback will be reviewed and responded to before a data standard is made by the Chair.
--
Original post: December 18th, 2024
This decision proposal outlines and seeks feedback on the proposed standard changes for incorporating the Last Consumer Change Date (LCCD) into the CDR standards for the energy sector.
The proposal covers changes to the standards for:
The proposal for consultation is attached below:
Decision-Proposal-361-Energy LCCD-Phase-2.pdf
Community views are being sought on the draft standards and positions outlined in this paper. Feedback received will be considered before standards are proposed to the Chair to be made binding.
This consultation period will close on
FridayTuesday 4th February 2025. Friday 7th February 2025Decision made
The Chair's decision is linked from this comment.
The changes approved in the decision will be published in Standards v1.34.0.
The text was updated successfully, but these errors were encountered: