您将如何处理来自房地产平台的长期数据获取？
我正在进行一个房地产数据项目，试图了解从大型在线平台获取结构化数据的最佳实践，以确保其可靠性和可扩展性。<p>在大多数有用数据通过前端行为（网络调用、客户端请求）呈现，而仅有有限的官方API可用的情况下，经验丰富的团队通常如何从长远来看处理这个问题？我特别感兴趣的是人们如何看待前端观察与后端数据源、设计稳健的数据管道、应对频繁变化，以及避免那些经常崩溃的脆弱设置。<p>我非常希望听到其他人在真实生产系统中是如何处理这个问题的，以及他们希望在早期阶段做出哪些不同的决策。
查看原文
I’m working on a real estate data project and trying to understand best practices for acquiring structured data from large online platforms in a way that’s reliable and scalable.<p>In cases where most of the useful data is surfaced through frontend behaviour (network calls, client side requests) and only limited official APIs are available, how do experienced teams usually approach this long term? I’m particularly interested in how people think about frontend observation vs backend data sources, designing resilient pipelines, handling frequent changes, and avoiding brittle setups that constantly break.<p>Would really appreciate hearing how others have approached this in real production systems and what they wish they had done differently early on.