Exercise: Solve this exercise in Go with test cases.
MongoDB Oplog to SQL Parser exerciseLabels: Advanced
Time to complete: 2-3 weeks
What will you learn:
- Go’s reflect package
- Writing tests for go routines
- JSON marshaling and unmarshalling
- MongoDB, Oplog parsing, translating Oplog to SQL, understanding some bits of PostgreSQL and MongoDB internals
- Data pipelining and processing
- Wiring the whole system, understanding system components, failure points, performance optimizations, distributing this architecture, etc.
- Context package for graceful shutdown of the application
- Golang concurrency
How to evaluate your solution:
Actual Solution:
Don’t look at the solution unless you have to. Otherwise, you’re not getting much value from the bootcamp.
I know what I am doing; stop patronizing me.
- If you say so 🤷, Here’s the sample implementation -https://github.com/one2nc/mongo-oplog-to-sql
Resources:
- MongoDB Oplog documentation - https://www.mongodb.com/docs/manual/core/replica-set-oplog/
- MongoDB Oplog populator - Feel free to use this utility to populate the data in Mongo Database for testing purposes. https://github.com/one2nc/mongo-oplog-populator
- The Context Package - https://www.youtube.com/watch?v=LSzR0VEraWw
Â