about
About Me
GITHUB: CalvinNeo
EMAIL: calvinneo@calvinneo.com
BLOG: www.calvinneo.com
EDUCATION:
- BE: Civil Engineering at Hohai University
- ME: Software Engineering at Nanjing University
- HONOURS: I have won several prizes in ACM/ICPC, CCPC, RoboCup(China Region), Zhou Peiyuan Mechanics Competition, etc.
OPEN-SOURCED PROJECTS:
- Nuft is an implementation of Raft protocol.
- ATP is a reliable transmission protocol built on UDP.
- CFortranTranslator is a line-by-line translator from Fortran77/90 to C++14.
- PolyClip clips millions of circles and lines with a polygon in seconds.
- Citation4Word is a word citation format for thesis.
- NuCut is a graph partitioning system.
INTERNSHIP:
- Tencent Inc. IEG Group. Shenzhen, China. June 2018 - Sept 2018
CAREER:
- Tencent Inc. IEG Group. Shenzhen/Shanghai, China. July 2019 - Aug 2021
- A platform to predict professional LOL game winning rate.
- An AI for crushing game(like CandyCrush) to simulate online player’s behavior.
- A platform to optimize performance of IEG’s maching learning system.
- Fuse execution of JAR/SQL components.
- Develop machine learning algorithm modules, including classification/clustering/model evaluation. Metadata management of the platform.
- Optimization suggestion by analysing Spark/Gc/Event logs.
- PingCAP. Remote/Shanghai, China. Aug 2021 -
- TiFlash Committer, TiFlash Proxy Maintainer and TiKV Reviewer
- Refactoring management of TiFlash replicas.
- In charge of the KVStore component.
- Write the committed data into the underlying columnar storage.
- A minimal raft fsm to manage uncommitted region data on TiFlash.
- Implement Learner Read and ReadIndex to support read with strong consistency.
- Implement Raft Snapshots to support bootstrapping peers from various heterogeneous data. Support decoding and transforming big snapshots in parallel.
- Proactive flushing in background. Reduce latency by 50%.
- In charge of the TiFlash Proxy component.
- See Implementation of Proxy for more introduction of TiFlash Proxy. However, it roughly do the following:
- Join the TiKV cluster as a raft Learner and replicate data from raft Leader.
- Align the different persisting strategies between TiKV and TiFlash.
- Interact with TiFlash through FFI interfaces.
- Decouple TiFlash Proxy from TiKV
- See Implementation of Proxy for more introduction of TiFlash Proxy. However, it roughly do the following:
- Cloud native TiFlash.
- Fast scale out and recovery on S3. Scaling the second TiFlash node throughput 17x, mem 20%↓, cpu 96%↓.
- Support storing raft logs on TiFlash rather than TiKV.
- Partitioned Raft KV, TiFlash part.
- Support TiFlash join a PRKV cluster as a non-PRKV learner.
- O11y
- Reduce memory errors like segfaults and OOMs, by introducing new tools.
- TiFlash Committer, TiFlash Proxy Maintainer and TiKV Reviewer
- Tencent Inc. IEG Group. Shenzhen/Shanghai, China. July 2019 - Aug 2021
CV:
- Please send an email to calvinneo@calvinneo.com, identify yourself and get my up-to-date CV.