2023-03-06
2023-03-06
DataHub Next Standup
Present: rufus, ola, joao
Agenda
- Blockers / questions
- Review table features
- Create new issues about implementing there
- Discussion re processing pipeline
- Next steps ✅2023-03-06 created issue https://github.com/datopian/datahub-next/issues/27
Joao - Action from Friday
- analysing what would be needed to replace the render layer of "Flowershow"
- open issue about what is needed to get new markdown rendering pipeline working (DataHub / Flowershow Next) e.g. without filesystem dependencies etc
- Issue created: https://github.com/datopian/datahub-next/issues/27
- open issue about what is needed to get new markdown rendering pipeline working (DataHub / Flowershow Next) e.g. without filesystem dependencies etc
Questions
- João
- When we say what is needed to get new render pipeline working, are we talking about replacing contentlayer or about making our current deployment work or both? I suspect it's the deploy because of the i.e. without filesystem dependencies etc part.
- I think both making the deployment work properly and replacing contentlayer are part of that, since replacing contentlayer is an obvious part of the render pipeline and making SSR work is also relevant to achieve that goal.
- What exactly is our render layer? What features does that include? On flowershow, would that be the contentlayer implementation?
- render pipeline + render pipeline use. That would include how we are getting the raw source data and where we are actually rendering the final result.
- What is exactly our render pipeline? Is that the set of components, pages and lib items that we have in order to render an MDX+D file?
- It's the process of transforming markdown "text" (raw source) into a minimally styled html document, including also applying transformations using rehype and remak, and outputting that. In this project, I would say it's our
lib/markdown.mjs
file.
- It's the process of transforming markdown "text" (raw source) into a minimally styled html document, including also applying transformations using rehype and remak, and outputting that. In this project, I would say it's our
- When we say what is needed to get new render pipeline working, are we talking about replacing contentlayer or about making our current deployment work or both? I suspect it's the deploy because of the i.e. without filesystem dependencies etc part.
Rufus Plan
- Review yesterday's tasks 2023-03-05
- What's confusing about contentlayer
- What's a markdown processing pipeline mermaid sketch in ../markdown-pipeline
- Markdown processing complexity ../../Excalidraw/markdown-pipeline-complexity-evolution-2023-03-06.excalidraw
- What's a ContentBase? ../contentbase
- What is markdowndb or a markbase? ../markdowndb
- How does it relate to MarkdownDB?