Building a near Real Time Model in Power BI

[mlonsk]

@bernatagulloesbrina has a new blog using some nice C# scripts that creates and updates partitions to always have the newest data in the semantic model.
https://www.esbrina-ba.com/building-my-first-near-real-time-model-in-power-bi/

[bernatagulloesbrina]

thank you for sharing!
now if anyone has any hint on the best way to synchronize it with a ETL running on AWS I would appreciate it!

[otykier]

Hi @bernatagulloesbrina
Thanks for writing the article. While I certainly enjoy seeing Tabular Editor used to solve issues in creative ways, I can't help feeling that using PowerShell to run Tabular Editor to execute a C# script that creates/refreshes partitions, is a bit of a "crossing the stream to get water" situation.

Did you know that you can execute TMSL commands directly from PowerShell, using the Invoke-ASCmd cmdlet? With TMSL scripts, you can create and refresh partitions (and more) - and by using the sequence command the whole thing is even executed within a transaction, which gets automatically rolled back in case something fails (so you don't leave your model with empty partitions, if the refresh fails for some reason, for example).

With regards to your question:

now if anyone has any hint on the best way to synchronize it with a ETL running on AWS I would appreciate it!

I know absolutely nothing about ETL on AWS, but wouldn't it be possible to instruct the ETL process to call a web function once the ETL completes? Sort of like a webhook? In that case, you can set up your PowerShell script to run in an Azure Runbook with a HTTP trigger.

[bernatagulloesbrina]

Thank you Daniel! I'm totally biased towards using tabular editor scripts, i know. I did see that is possible to run tmsl commands from powershell, but building the command is way beyond my knowledge of powershell I'll check your link, but I'm afraid that it will force me to learn yet two or three extra programming languages 😀 El dl., 11 de des. 2023, 11:41, Daniel Otykier ***@***.***> va escriure:

…

Hi @bernatagulloesbrina <https://github.com/bernatagulloesbrina> Thanks for writing the article. While I certainly enjoy seeing Tabular Editor used to solve issues in creative ways, I can't help feeling that using PowerShell to run Tabular Editor to execute a C# script that creates/refreshes partitions, is a bit of a "crossing the stream to get water" situation. Did you know that you can execute TMSL commands directly from PowerShell, using the Invoke-ASCmd cmdlet <https://learn.microsoft.com/en-us/powershell/module/sqlserver/invoke-ascmd?view=sqlserver-ps>? With TMSL scripts, you can create and refresh partitions (and more) - and by using the sequence command <https://learn.microsoft.com/en-us/analysis-services/tmsl/sequence-command-tmsl?view=asallproducts-allversions> the whole thing is even executed within a transaction, which gets automatically rolled back in case something fails (so you don't leave your model with empty partitions, if the refresh fails for some reason, for example). With regards to your question: now if anyone has any hint on the best way to synchronize it with a ETL running on AWS I would appreciate it! I know absolutely nothing about ETL on AWS, but wouldn't it be possible to instruct the ETL process to call a web function once the ETL completes? Sort of like a webhook? In that case, you can set up your PowerShell script to run in an Azure Runbook with a HTTP trigger <https://learn.microsoft.com/en-us/azure/automation/automation-webhooks?tabs=portal> . — Reply to this email directly, view it on GitHub <#1196 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJUUXHPCYW7JO322H5TTNI3YI3PMVAVCNFSM6AAAAABAPQMFNCVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TQMJYGM2DM> . You are receiving this because you were mentioned.Message ID: <TabularEditor/TabularEditor3/repo-discussions/1196/comments/7818346@ github.com>