- Getting a lot of new information
- Don't understand where we're going
Next lecture, we'll zoom out.
John Paul Farmer served as the 3rd Chief Technology Officer of New York City, taking point on everything from broadband to digital services to AI. Prior to that, he spent a handful of years at Microsoft, building connections with cities and the civic tech community. Previously, he was Senior Advisor for Innovation in the White House Office of Science and Technology Policy under President Obama, where he confounded and led the Presidential Innovation Fellows. He has also served as an adjunct associate professor at a Columbia and a Fellow of the University of Pennsylvania’s Institute for Urban Research. Most recently, he served as President of a next-gen broadband technology company and is now the President of Smart City Expo USA.
- Name
- What you're passionate about
Anything you'd like to share?
It can be helpful to track the load information for each row. These might be things like:
_LOADED_FROM: filename, if applicable_LOADED_AT: timestamp
"Give me the data from the most recent load"
CREATE TABLE my_table AS
SELECT
*,
current_localtimestamp() AS _LOADED_AT,
filename AS _LOADED_FROM
FROM read_csv('[path]', filename=true);INSERT INTO my_table
SELECT
*,
current_localtimestamp() AS _LOADED_AT,
filename AS _LOADED_FROM
FROM read_csv('[path]', filename=true);You can imagine the equivalent in a DataFrame.
SELECT *
FROM my_table
WHERE _LOADED_AT = (SELECT MAX(_LOADED_AT) FROM my_table);BEGIN TRANSACTION;
INSERT INTO ...;
COMMIT;