How to get items back after put_item to dynamo db [RUST]

[Bryson14]

After putting an item to dynamoDB, I'm getting an error back that put_item.attributes is None. What more is that the item is put into the database and is present when I check.

let response = client
        .put_item()
        .table_name(table_name)
        .set_item(Some(item_serialized))
        .send()
        .await;

    info!("{:?}", response);

    match response {
        Ok(output) => match output.attributes() {
            Some(item_map) => {
                let item: Result<T, _> = from_item(item_map.clone());

                // returns item Ok(T) or handles the error
                item.map_err(|_| {
                    let response = json!({
                        "error_message": format!(
                            "Error deserializing item from table representation {}",
                            table_name),
                            "item": format!("{:?}", item_map)
                    });
                    error!("{}", response);
                    (StatusCode::INTERNAL_SERVER_ERROR, Json(response))
                })
                // map_err will return type T
            }
            None => {
                let response = json!({
                    "error_message": format!(
                        "No attributes returned after put_item in table '{}'",
                        table_name),
                        "item": format!("{:?}", item)
                });
                error!("{}", response);
                Err((StatusCode::INTERNAL_SERVER_ERROR, Json(response)))
            }
        },
        Err(_) => {
            let response = json!({
                "error_message": format!(
                    "Error saving item into table {}",
                    table_name),
                    "item": format!("{:?}", item)
            });
            error!("{}", response);
            Err((StatusCode::INTERNAL_SERVER_ERROR, Json(response)))
        }
    }
    ```
    
    When checking the return I get this:
    
    ```
    "body": "{\"error_message\":\"No attributes returned after put_item in table 'ConversationsTable-dev'\",\"item\":\"Conversation { conversation_id: 7649eeb6-d924-4e87-8530-a4db02600968, user_id: c8089eae-5e7d-11ec-94c8-b42e99b5b2c6, update_time: 2024-01-11T19:38:42.225411010Z, create_time: 2024-01-11T19:38:42.225411641Z, title: Some(\\\"conversation 2\\\"), is_archived: false }\"}",

Then also checking the info printout of the response, I get this:

INFO Lambda runtime invoke{requestId="adfe8daa-b345-42af-b041-7df81cd2ff18" xrayTraceId="Root=1-65a043c1-17c1d9996f3fec7236907d74;Parent=5551730d0ccdd338;Sampled=0;Lineage=b2a823c1:0"}:request{method=POST uri=/conversation version=HTTP/1.1}: Ok(PutItemOutput { attributes: None, consumed_capacity: None, item_collection_metrics: None, _request_id: Some("7N8JSE053OEO08UOOV5VEGUP2BVV4KQNSO5AEMVJF66Q9ASUAAJG") })

So following the example from the sdk by calling resp.attributes() doesn't work. Also calling resp.attribute (not the method) doesn't work either.

Any help here?

[rcoh]

interesting. Hard to know without seeing the raw response from DynamoDB. Can you log the raw response with RUST_LOG=aws_smithy_runtime=trace? (and enabling a logger, e.g tracing_subscriber)

[Bryson14]

I set both the env vars RUST_LOST and aws_smithy_runtime to trace

Here is the full results from that :

timestamp,message
1705013198536,"INIT_START Runtime Version: provided:al2023.v10	Runtime Version ARN: arn:aws:lambda:us-east-1::runtime:389fcaae1b213b40d38ed791dfb615af1a71a32d6996ff7c4afdde3d5af4b6f2
"
1705013198577,"INFO get region provider with None
"
1705013198589,"INFO DynamoDB client version: 1.9.0
"
1705013198596,"INFO Region:                  us-east-1
"
1705013198596,"DEBUG load_config_file{file=Default(Config)}: config file not found path=~/.aws/config
"
1705013198596,"DEBUG load_config_file{file=Default(Config)}: config file loaded path=Some(""~/.aws/config"") size=0
"
1705013198596,"DEBUG load_config_file{file=Default(Credentials)}: config file not found path=~/.aws/credentials
"
1705013198596,"DEBUG load_config_file{file=Default(Credentials)}: config file loaded path=Some(""~/.aws/credentials"") size=0
"
1705013198609,"DEBUG connecting to 127.0.0.1:9001
"
1705013198610,"DEBUG connected to 127.0.0.1:9001
"
1705013198612,"START RequestId: 52ab5a95-70d9-43e6-869e-421bb91acae3 Version: $LATEST
"
1705013198612,"DEBUG pooling idle connection for (""http"", 127.0.0.1:9001)
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}: started processing request
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: entering 'serialization' phase
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: entering 'before transmit' phase
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: no client rate limiter configured, so no token is required for the initial request.
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: retry strategy has OKed initial request
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: beginning attempt #1
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: resolving endpoint endpoint_params=EndpointResolverParams(TypeErasedBox[!Clone]:Params { region: Some(""us-east-1""), use_dual_stack: false, use_fips: false, endpoint: None }) endpoint_prefix=None
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: will use endpoint Endpoint { url: ""https://dynamodb.us-east-1.amazonaws.com"", headers: {}, properties: {} }
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt:lazy_load_identity:provide_credentials{provider=default_chain}: loaded credentials provider=Environment
"
1705013198613,"INFO Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt:lazy_load_identity: identity cache miss occurred; added new identity (took Ok(29.711µs))
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: loaded identity
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: entering 'transmit' phase
"
1705013198613,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: new TCP connector created in 312ns
"
1705013198613,"DEBUG resolving host=""dynamodb.us-east-1.amazonaws.com""
"
1705013198620,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: connecting to 3.218.182.100:443
"
1705013198621,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: connected to 3.218.182.100:443
"
1705013198639,"DEBUG flushed 2059 bytes
"
1705013198662,"DEBUG parsed 7 headers
"
1705013198662,"DEBUG incoming body is content-length (2 bytes)
"
1705013198662,"DEBUG incoming body completed
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: pooling idle connection for (""https"", dynamodb.us-east-1.amazonaws.com)
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: entering 'before deserialization' phase
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: entering 'deserialization' phase
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt:deserialization:deserialize_nonstreaming: request_id=Some(""A4P47T515JVHE8A343TQF11G4JVV4KQNSO5AEMVJF66Q9ASUAAJG"")
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op:try_attempt: entering 'after deserialization' phase
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: request succeeded, no retry necessary
"
1705013198662,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}:invoke{service=dynamodb operation=PutItem}:try_op: a retry is either unnecessary or not possible, exiting attempt loop
"
1705013198662,"INFO Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}: Ok(PutItemOutput { attributes: None, consumed_capacity: None, item_collection_metrics: None, _request_id: Some(""A4P47T515JVHE8A343TQF11G4JVV4KQNSO5AEMVJF66Q9ASUAAJG"") })
"
1705013198662,"ERROR Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}: {""error_message"":""No attributes returned after put_item in table 'ConversationsTable-dev'"",""item"":""Conversation { conversation_id: 55c05b17-c27b-4226-b04b-ca32b3963a47, user_id: c8089eae-5e7d-11ec-94c8-b42e99b5b2c6, update_time: 2024-01-11T22:46:38.613068598Z, create_time: 2024-01-11T22:46:38.613068934Z, title: Some(\""my test conversation\""), is_archived: false }""}
"
1705013198662,"INFO Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}: finished processing request latency=49 ms status=500
"
1705013198662,"ERROR Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}:request{method=POST uri=/conversation version=HTTP/1.1}: response failed classification=Status code: 500 Internal Server Error latency=49 ms
"
1705013198664,"DEBUG Lambda runtime invoke{requestId=""52ab5a95-70d9-43e6-869e-421bb91acae3"" xrayTraceId=""Root=1-65a06fce-757a20aa7cf02c01603c66fe;Parent=06aa95241e3d5769;Sampled=0;Lineage=b2a823c1:0""}: reuse idle connection for (""http"", 127.0.0.1:9001)
"
1705013198679,"DEBUG pooling idle connection for (""http"", 127.0.0.1:9001)
"
1705013198679,"DEBUG reuse idle connection for (""http"", 127.0.0.1:9001)
"
1705013198682,"END RequestId: 52ab5a95-70d9-43e6-869e-421bb91acae3
"
1705013198682,"REPORT RequestId: 52ab5a95-70d9-43e6-869e-421bb91acae3	Duration: 67.58 ms	Billed Duration: 143 ms	Memory Size: 128 MB	Max Memory Used: 21 MB	Init Duration: 75.03 ms	
"

[Bryson14]

Oh my bad, I didn't change the trace limit on the subscriber
trace.csv

[Skynoodle]

If I understand the AWS documentation, this is considered correct behaviour and it's the SDK for Rust code example that's wrong here. The DynamoDB PutItem response doesn't, by default, include any item attributes1. Unlike certain other DynamoDB actions it also doesn't support returning the new item attributes at all - only the default NONE or ALL_OLD to get the previous item. This request parameter is correctly exposed by the Rust SDK2, but because of the underlying API limitation won't be of any help here. Presumably, supporting ALL_NEW in this API action was deemed redundant since PutItem is always a complete replacement so, if successful, the caller always knows exactly what the resulting item looks like anyway having provided all the attributes in the first place.

[rcoh]

yeah this seems correct. I agree that I think the example is wrong.

[Bryson14]

Okay that makes sense. I think the documentation isn't clear about what the meaning of ALL OLD term.