streaming-lakehouse skillA
streaming-lakehouse is agent-read markdown (skill) from yuecao365/offercome: 实时与湖仓深挖:开放表格式、CDC、流处理状态与一致性、批流一体、数据新鲜度、成本。.
Indexed from public GitHub and served as immutable, content-addressed versions. Install it pinned to an exact SHA-256 with the mdr CLI, and every file is verified against the hash recorded here before it reaches your agent. The deterministic audit below grades the latest version, and the same file always earns the same grade.
What the file says
## 面试官在意什么 这本是数据工程往实时与湖仓方向的深挖。2026 年的面试重点:表格式(Iceberg 一类)为什么成了标准、解决了什么(ACID、schema 演进、时间旅行、跨引擎);CDC 到湖的链路怎么保证一致;流处理的状态、水位、exactly-once 到底靠什么;批流一体是真统一还是两套代码;AI 场景要多新鲜的数据、代价多大。面试官追的是一次数据不一致或延迟事故的归因。 ## 项目 / 实习怎么深挖 简历上出现下面这类经历时从哪里切、追什么。追到候选人能说出机制、数字的来源与一次真实的故障或取舍才算实;只有框架名与结论、说不出自己那一段的,记为危险信号。通用的追问方法见 project-deep-dive。 - 简历出现 Iceberg / Delta / Hudi → 追为什么选它、schema 演进与时间旅行用过没有、小文件与 compaction 怎么治、跨引擎读写有没有问题 - 简历出现 CDC → 追工具与链路、初始快照与增量怎么衔接、乱序与重复怎么处理、延迟多少 - 简历出现 Flink / 流处理 → 追状态大小、checkpoint 间隔、水位怎么定、exactly-once 靠什么、反压怎么排查 - 简历出现批流一体 → 追是一套代码还是两套、口径怎么对齐、修数怎么做 - 简历出现"实时" → 追端到端延迟数字、新鲜度 SLA 谁定、超了怎么办 - 简历出现湖仓成本 → 追存储与计算各多少、小文件、分区与排序对查询的影响 ## 常见失守与危险信号 - 实时链路与流处理:说不出水位与事件时间;exactly-once 只会说"Flink 支持";反压不知道怎么看 - 存储格式与湖仓:不知道列式格式为什么快;表格式只答"就是元数据";小文件问题没处理过 - 成本与性能优化:只会加机器;不知道分区与排序对扫描量的影响 - 开放表格式:说不出快照与元数据层的结构;schema 演进没用过;compaction 拍脑袋 - CDC 链路:初始快照与增量衔接说不清;乱序与重复没处理;延迟没数字 - 流处理状态与一致性:状态放哪、多大不知道;checkpoint 失败没处理过;端到端一致性说不清 - 批流一体:两套代码口径对不上;修数靠人肉 - 数据新鲜度与 AI 场景:不知道下游要多新鲜;新鲜度没有 SLA 与监控 ## 常考主题清单 只列名字、阶梯与答实的标志,作"问到哪一层算实"的参考;问哪些、问几道由这份 JD 与这份简历定,不是配额。 ### 实时链路与流处理 …
Read the whole file at its exact version.
How to install
mdr add yuecao365/offercome/streaming-lakehouse@git:20260920.a4843f5mdr add yuecao365/offercome/streaming-lakehouse@sha256:4a4082cb434ed10bPin to a label to follow the author's releases, or to a sha256 to freeze the exact bytes forever. Either way the resolved hash is written to mdr.lock, and mdr install reproduces it on any machine.
[](https://markdownregistry.com/a/art_oa4kjd4xkq3clhyq)
1 badge views in 30 days
Versions
Audit of the latest version
- pass: Frontmatter block present
- pass: Frontmatter declares a name
- pass: Frontmatter declares a description
- pass: Size between 200 bytes and 200 KB (6572 bytes)
- pass: No zero-width or bidi control characters
- pass: No instruction hidden inside an HTML comment
- pass: No link to an exfiltration or paste host
- pass: No credential-shaped string
- pass: No instruction to send local credentials anywhere
- pass: No text hidden with inline styles
- pass: No prompt-injection phrasing
- pass: No curl or wget piped into a shell
- pass: No recursive delete of root, home or parent
- pass: No instruction to read or print local credentials
- pass: No base64 blob over 200 characters
- pass: No link to a raw IP address
- pass: No script tag
Source
yuecao365/offercome · 23 stars · license MIT · pushed 2026-09-23 · branch main
API
GET https://markdownregistry.com/api/v1/artifacts/art_oa4kjd4xkq3clhyq GET https://markdownregistry.com/api/v1/resolve?ref=yuecao365/offercome/streaming-lakehouse GET https://markdownregistry.com/api/v1/blob/4a4082cb434ed10bcc43ee2625eda94407dab7479eeb42101771a7393290af85
Your agent does the legwork. You hear about the deals worth your word. Hand yours the standing instructions at modelranch.com and it joins the network that reads files like this one.