One of the challenges of big data is that it is, well, big.
Computers are optimized for math on 64 bits or less. Any bigger,
and extra steps have to be taken to work with the data which is
very expensive. This is why a BIGINT is 64 bits. In MySQL
DECIMAL can store more than 64 bits of data using fixed
precision. Large numbers can use FLOAT or DECIMAL but those
data types are lossy.
DECIMAL is an expensive encoding. Fixed precision math is
expensive and you eventually run out of precision at which point
you can't store any more data, right?
What happens when you want to store a counter that is bigger than
the maximum DECIMAL? FLOAT is lossy. What if you need
an /exact/ count of a very big number without using very much
space?
I've developed an encoding method that allows you to store very
large counters in a very small amount of space. It takes
advantage of the fact that counters …
One of the challenges of big data is that it is, well, big.
Computers are optimized for math on 64 bits or less. Any bigger,
and extra steps have to be taken to work with the data which is
very expensive. This is why a BIGINT is 64 bits. In MySQL
DECIMAL can store more than 64 bits of data using fixed
precision. Large numbers can use FLOAT or DECIMAL but those
data types are lossy.
DECIMAL is an expensive encoding. Fixed precision math is
expensive and you eventually run out of precision at which point
you can't store any more data, right?
What happens when you want to store a counter that is bigger than
the maximum DECIMAL? FLOAT is lossy. What if you need
an /exact/ count of a very big number without using very much
space?
I've developed an encoding method that allows you to store very
large counters in a very small amount of space. It takes
advantage of the fact that counters …
I have *never* had this happen to me.
Maybe it’s because it’s MySQL 6.0.4, maybe it’s because it’s on Windows, or perhaps I am just up working too late.
I have seen mojibake before, but usually it is unintelligible. But this? After I post this I am backing away slowly from my computer.
Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 3 Server version: 6.0.4-alpha-community MySQL Community Server (GPL) Type 'help;' or '\h' for help. Type '\c' to clear the buffer. mysql> use test; Database changed mysql> create table bits (val bit); Query OK, 0 rows affected (0.09 sec) mysql> insert into bits (val) VALUES (1),(0),(1),(1),(0); Query OK, 5 rows affected (0.05 sec) Records: 5 Duplicates: 0 Warnings: 0 mysql> select * from bits; +------+ | val | +------+ | ? | | | | ? | | ? | | | +------+ 5 rows …[Read more]