I’m completely stumped as to why DateTimeDiff evaluates to null when comparing dates from my Glue-exported S3 files. My Python code generates ISO 8601 strings like 2023-10-27T14:00:00+01:00, but Architect seems to ignore the offset. Should I be using GetDayOfWeek as a workaround, or is there a specific format requirement I am missing? The expression ${DateTimeDiff(${System.DateTime}, ${Data.myDate})} fails silently in the validation step, which is frustrating.
My usual workaround is to ensuring the input string strictly adheres to the ISO 8601 standard without any trailing whitespace or malformed offset characters, as the parser is notoriously strict.
The expression itself is correct, but you must validate the source data type before passing it to DateTimeDiff to prevent silent null returns.
Consider adding a FormatDateTime step prior to the difference calculation to normalize the timezone offset explicitly.