Questions tagged [file-formats]
The file-formats tag has no summary.
24 questions
7 votes
2 answers
361 views
Why GUID Partition Table data lack the sector size?
The GPT (GUID Partition Table) is the most accepted modern standard for partitioning of a data storage device. Its unit for the offset and size of a partition is so-called sector*. Is it a well-...
- 179
0 votes
1 answer
222 views
Selecting the endianness of data in files generated by an embedded system
I have an embedded system running on a little-endian Cortex-M3. This system is able to accept packets from the network and reply to them. Now, I would like the system to start generating files. These ...
- 2,099
-1 votes
1 answer
212 views
Why do HTML and JS feel slow on smartphones? What could be changed to make them faster? [closed]
HTML rendering and javascript engines are very optimized, so why do they feel slow on smartphones? It seems that HTML's low performance justified the creation of mobiles "apps" which are ...
- 2,280
1 vote
3 answers
248 views
Using source code instead of XML/JSON or other custom serialization schemes and binary file formats
For a while now I have been toying with the idea of using source code as a file storage format. My question: How to support format version changes? (loading of older files with structural differences) ...
- 127
-3 votes
1 answer
109 views
Is it possible to extend gifs to support audio? [closed]
Can the file format gif be extended to support audio as well? I was looking into gifs that support audio and the main gif sites with "audio gifs" are just looping videos. The problem is how ...
- 101
13 votes
8 answers
5k views
In what configuration file format do regular expressions not need escaping?
I want a configuration file for a .NET program. This file is to configure pairs of regular expressions. The regular expressions belong within a hierarchy of sections. Section1 SubsectionA ...
- 3,427
0 votes
5 answers
260 views
Choosing a MagicNumber or Signature for a Binary File Format
I'm defining some binary formats to encode some information and dump it to a file. I want to place a MagicNumber/Signature at the beginning of files encoded in my format to be able to tell them apart ...
- 171
0 votes
1 answer
941 views
Best file formats for ML training
Hi I'm bulding an ML pipeline with PyTorch to support various tasks and am looking for some advice on efficient ways to store processed data. The main frame work was 3 layers [data prep] -> [data ...
- 111
-1 votes
2 answers
962 views
How to handle multiple versions of binary file format
I'm writing a reader for the custom binary file format used in one game. The format has multiple versions for example: struct FileHeader { ushort version; uint fieldX; // version 1 uint ...
- 1,569
0 votes
1 answer
2k views
Getting file format by checking file header [closed]
I'm writing a program, part of which consists of determining if a given file is a PNG. Knowing that a file doesn't have to be named with its respective filename extension to be of a certain type, I ...
- 111
0 votes
2 answers
104 views
What are formats to store geographic maps for a robot to travel point A to point B
Very beginner. Need to compute route from A to B for a robot. i would like to know how to store area map and compute the route. I can compute shortest path etc using algorithms e.g. dijkstra. What ...
- 47
1 vote
2 answers
623 views
Design Pattern to extract arbitrary field from arbitrary file format
Lets say I have multiple file types: .json, .csv ... etc These file types come in different formats: Second json structure Extra column added to csv etc. I need to extract fields from these files; ...
- 152
1 vote
2 answers
581 views
How a standard video file is structured under the hood
I am new to looking into video file formats, and am wondering what it would take to parse one. To do that, I first would need to understand what the format looks like, so that's what this question is ...
- 2,787
50 votes
4 answers
46k views
Should UTF-8 CSV files contain a BOM (byte order mark)?
Our line-of-business software allows the user to save certain data as CSV. Since there are a lot of different formats (all called "CSV") in use in the wild, we are tying to decide what the &...
- 9,868
10 votes
3 answers
2k views
SQLite database as a data interchange format?
Is it sensible/reasonable to consider using an SQLite database file as a data interchange format? Are there any obvious gothchas or reasons not to do this? Example. Say I have a master SQL Server ...
- 375