Customize UUIDv7 generation for database partitioning
@picnixz 已经在做这个了。
开始于 2025年3月4日。
- 主要语言
- Python
- 星标
- 77.2k
- 派生
- 35.9k
- PR 合并指标
- PR 指标待抓取
描述
Feature or enhancement
Proposal:
Support for UUIDv7 via uuid7() has just landed in main: https://github.com/python/cpython/issues/89083
One use-case for UUIDv7 is using it as PK in databases. Since it is time based, it can also be used as partition key (e.g., to use one partion for each day). In order to calculate the partition range, you need calculate the "minimal" UUID for a given date (i.e., 2025-04-05 00:00:00 and use all zeros for the random bits => 0196033f-4400-7000-8000-000000000000).
I'm totally fine with uuid.uuid7() not taking any arguments, but it would be cool if the building blocks for generating a UUIDv7 based on custom unix_ts_ms, counter, and tail could be exposed as well.
def min_uuid7(date: datetime.datetime | None) -> UUID:
# This is just for convenience and could be left out:
if date is None:
today = datetime.date.today()
date = datetime.datetime(
today.year, today.month, today.day, tzinfo=datetime.UTC
)
# Provide a custom timestamp and a custom counter and tail
timestamp_ms = int(date.timestamp() * 1_000)
counter, tail = 0, 0
# The remainder is the same as in uuid7():
unix_ts_ms = timestamp_ms & 0xFFFF_FFFF_FFFF
counter_msbs = counter >> 30
# keep 12 counter's MSBs and clear variant bits
counter_hi = counter_msbs & 0x0FFF
# keep 30 counter's LSBs and clear version bits
counter_lo = counter & 0x3FFF_FFFF
# ensure that the tail is always a 32-bit integer (by construction,
# it is already the case, but future interfaces may allow the user
# to specify the random tail)
tail &= 0xFFFF_FFFF
int_uuid_7 = unix_ts_ms << 80
int_uuid_7 |= counter_hi << 64
int_uuid_7 |= counter_lo << 32
int_uuid_7 |= tail
# by construction, the variant and version bits are already cleared
int_uuid_7 |= _RFC_4122_VERSION_7_FLAGS
return UUID(int=int_uuid_7)
>>> min_uuid7(datetime.datetime(2025, 4, 5, tzinfo=datetime.UTC))
UUID('0196033f-4400-7000-8000-000000000000')
Another useful addition might be a helper that recovers the original datetime/timestamp from a UUIDv7. I understand that this is additional code that might be slightly out of context, but such functions - like uuid7() - would probably not need to be changed, but are not trivial to implement for "normal users".
These functions could look like this:
def uuid_to_timestamp_ms(uuid: UUID) -> int:
uuid_flags = uuid.int & _RFC_4122_VERSION_7_FLAGS
if uuid_flags != _RFC_4122_VERSION_7_FLAGS:
raise ValueError(f"{uuid} is not a v7 UUID.")
return int.from_bytes(uuid.bytes[:6])
def uuid_to_datetime(uuid: UUID) -> datetime.datetime:
ms_since_epoch = uuid_to_timestamp_ms(uuid)
return datetime.datetime.fromtimestamp(ms_since_epoch / 1_000, tz=datetime.UTC)
>>> d = datetime.datetime(2025, 4, 5, tzinfo=datetime.UTC)
>>> u = min_uuid7(d)
>>> assert uuid_to_datetime(u) == d
Has this already been discussed elsewhere?
This is a minor feature, which does not need previous discussion elsewhere
Links to previous discussion of this feature:
No response
Linked PRs
- gh-131838
- gh-132154
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
评估
这个 Issue 还没有评估数据。