1. Researched and developed Mole, a distributed ETL tool that operates efficiently through Spark, providing data validation and consistency during the ETL process.

Development and Testing:

• Implemented cloud-to-ground data transmission functionality (AWS S3 to DB) and proxy functionality.

• Developed MongoDB and TeraData data transmission capabilities.

• Conducted unit, integration, and end-to-end testing using AWS EC2, EMR, RDS, and Docker.

Research and Learning:

• Investigated Spark's persist function, data permission levels, and lifecycle to enhance data consistency and efficiency.

• Studied the Hadoop ecosystem, including HDFS, HIVE, YARN, and others.

• Learned about Docker containerization for deployment and testing.

#Scala #Java #Shellscript #SQL

2. Contributed to the development of a smart healthcare project for sepsis, establishing ML models to optimize and improve physicians' ability to accurately diagnose sepsis and increase recall rates.

Data Processing:

• Employed DropNa, Duplicate, OneHotEncoder, Standardization, and distinguished between discrete and continuous data.

• Addressed imbalanced data using methods like Stratified Shuffle Split to ensure equal data proportions during training.

Feature Engineering:

• Utilized packages such as shap and eli5 to assess the importance of each feature and employed visualization tools like seaborn and Matplotlib for analysis.

Deployment:

• Transferred model environments and outcomes using Docker images, and set up a restful API with Flask for hospital use.

#Python #Tensorflow #Docker

Created fighter jet AI models using Linux and TensorFlow, performed data visualization, and engaged in web design and development.

Learned to collaborate on large projects, including code division and integration, standardization of programming practices, and technical documentation writing.

Short-term contracted agile development project for an Android platform App involving login, registration, data scraping, file upload, data processing, image transmission, and image sliding functionalities.

Developed using the MVVM model, Android Studio, MongoDB, and Postman, with version control managed through Google Source.

Developed the Chaoyang Electronic Newsletter website, responsible for login, message board, and admin site functionalities.

Utilized Django, incorporating JavaScript, Ajax, and PostgreSQL for development.

• Thesis: A Low-Risk, High-Profit Cryptocurrency Arbitrage System Based on Hedging

• Independently completed an AI decision-making screening system.

• Independently developed an automated quantitative trading system: Trend Quantitative Grid and Pattern Grid.

• Developed the Oh!DogCat Stray Animal Shelter Platform, responsible for backend programming, data analysis, and database development.

• Developed the Oh!DogCat Stray Animal LINE Official Chatbot, handling data processing, backend programming, and database development.

• Independently designed and developed a web game, completing the planning, story, scenes, prototype, implementation, and testing within one month.

• Developed a Stray Animal Shelter App using Swift.

• Participated in the organization team for the 23rd Competitive Cheerleading Squad, completing planning, fundraising, theme selection, personnel distribution, and formations within four months and achieving victory.

• Independently developed an online stock quote system using Jupyter Notebook.

• Ranked 10th in the National Business Skills Competition in Programming in 2015.

• First place in the Kaohsiung Digital Programming Contest.

• Leader of the Elite Society, guiding junior and senior high school students in activities and explaining the content.

• Executive Director of the Alumni Association Activities, planning graduation events, ceremonies, and yearbook design and production.

• Holds a certificate in Software Application (Level 2), Accounting Information (Level 3), and Web Design (Level 3).