Skip to content

About

Classical machine learning coursework in Python: classification, clustering, model evaluation and optimization, completed during bioinformatics studies.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

61 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Machine Learning Algorithms — From-Scratch Implementations & Experiments

Elena Dalboni da Rocha (@enterlina) · Portfolio · AI Engineering projects

A curated collection of 29 Python scripts and Jupyter notebooks from my bioinformatics machine-learning coursework. The focus is on understanding algorithms below the library API: implementing learning rules, distance functions, tree construction, statistical scoring, and optimization strategies, then exploring behavior through plots and evaluation metrics.

Technical focus: supervised learning · unsupervised learning · model evaluation · optimization · numerical computing · neural networks

Portfolio note: These are historical educational/research exercises, not deployed production services. Some implementations are experimental or incomplete. The repository preserves original code, including known limitations, so the work is auditable rather than implying benchmarks or reliability that have not been verified.

Projects and source code

01 · Nearest-neighbor methods

Distance-based classification on cancer and spam tables, with KD-tree queries, k-nearest neighbors, radius neighbors, leave-one-out-style error calculations, and a MinMax-scaled variant.

02 · Unsupervised clustering

Explorations of k-means centroid updates, agglomerative nearest-pair merging, and DBSCAN-style density neighborhoods. Cluster quality is examined with the Dunn index and scatterplots.

03 · Decision trees and classification metrics

An experimental CART-style decision tree with candidate feature thresholds and impurity criteria; separate ROC curves and AUC-based feature ranking for cancer and spam datasets.

04 · Bagged tree ensembles

Bootstrap sampling for multiple hand-built decision trees, aggregate prediction scores, ROC/AUC visualization, and a stratified cross-validation grid over tree counts and depths.

05 · Perceptron learning

A perceptron weight-update loop with polynomial feature expansion and plotted nonlinear decision boundaries on a two-dimensional synthetic dataset.

06 · Logistic regression and image classification

Hand-written logistic-regression loss, gradient updates, mini-batches and learning curves; MNIST/notMNIST image loading and normalization; Keras convolutional models comparing activations and character recognition.

07 · Support vector machines

Linear, polynomial and RBF SVM kernel decision boundaries; a separate comparison between linear SVM and a scikit-learn random forest on a cancer-classification exercise. Scripts and notebooks are preserved as companion formats.

08 · Probabilistic classification and regularized regression

Gaussian Naive Bayes from class priors and feature distributions; tokenization/stemming and word probabilities for SMS spam; polynomial least squares, Ridge (L2) and Lasso (L1) with R² and coefficient-count inspection.

09 · Combinatorial optimization: Traveling Salesperson Problem

Route-length minimization experiments using Monte Carlo permutations, random swaps, pair-swap hill climbing and a genetic algorithm with selection, crossover, mutation and elitism. Two hill-climbing files contain identical source.

Methods and engineering evidence

Capability Evidence in this repository
Algorithm implementation k-NN/radius voting, perceptron updates, CART-style splits, logistic-gradient steps, Gaussian and text Naive Bayes, route-search heuristics
Model selection and evaluation Accuracy, leave-one-out-style checks, ROC curves, AUC, Dunn index, R², stratified cross-validation
Feature engineering MinMax and standard scaling, polynomial feature maps, text tokenization/stemming, image normalization
Data visualization Decision boundaries, cluster scatterplots, ROC plots, regression fits and TSP routes
Deep learning TensorFlow/Keras CNN exercises for MNIST and notMNIST

Reproducibility and limitations

  • The original datasets (cancer.csv, spam.csv, blobs.csv, mnist.csv, notMNIST_small, tsp.csv and others) are not committed. Scripts reference historical absolute paths that must be replaced before running.
  • The historical environment is not pinned; modern Python, pandas, scikit-learn or Keras versions may require compatibility work.
  • Review the implementations before reuse: several contain logic errors, incomplete branches or evaluation issues. These files have been renamed and documented, not silently repaired or rerun.
  • The experiment titles describe the code's intended method, not an independently verified successful result. No production deployment, accuracy benchmark or clinical claim is made.

About the author

I'm an AI Product Designer and Design Engineer with a background in mathematical mechanics, bioinformatics and end-to-end product development. This archive documents my foundations in algorithmic thinking alongside my newer AI engineering work and product portfolio.

About

Classical machine learning coursework in Python: classification, clustering, model evaluation and optimization, completed during bioinformatics studies.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages