Timeline for Should serialization and deserialization be "atomic" transactions?
Current License: CC BY-SA 4.0
6 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Feb 16, 2023 at 10:54 | comment | added | Falco | The question usually boils down to "what is the smallest useful atomic chunk of data". A single RGB pixel is either complete or not. But for example a stream of logs or audio data, can usually be separated into logical chunks, where one still makes sense without the others. So each log line, or each unicode-character or each frame could be the atomic part. | |
| Feb 16, 2023 at 1:53 | comment | added | Mark | For an example of "partial transmission", some photo-album software I'm working on can track camera position in the form of (latitude, longitude, altitude, heading, pitch, roll). A position is considered valid if it has a valid latitude and longitude: if any of the other values is invalid, that particular value gets marked as "unknown", but if either the latitude or longitude is invalid, the entire position gets marked as "unknown". | |
| Feb 14, 2023 at 21:26 | comment | added | JimmyJames | @cmaster-reinstatemonica In a scenario like that, I would probably store the raw data as is before attempting to parse it. That way if you can't deserialize it for any reason, you don't lose information. But yes, that sounds like a valid use case. | |
| Feb 14, 2023 at 20:12 | comment | added | cmaster - reinstate monica | There is a second possible reason for not failing the deserialization: When the data is particularly valuable (think: downlink data from a voyager probe, or similar), it would be a good idea to implement the notion of a missing value into the data model. | |
| Feb 13, 2023 at 19:38 | comment | added | Patrick Wright | This is a very helpful statement: "all transmissions should be considered atomic and only once it is determined that a partial transmission can be tolerated, that you would implement any other solution." | |
| Feb 13, 2023 at 19:04 | history | answered | JimmyJames | CC BY-SA 4.0 |