r/learnmachinelearning • • 28m ago

Project Kapso: Evolving harness by learning from experimentation

1 Upvotes

Hey guys!

https://github.com/Leeroo-AI/kapso

We built Kapso, an engine that runs experiments toward an objective, deploys the best solution on your stack and learns from every run into a bank of lessons with a credence score and a boundary.

You can view a video walkthrough here: https://www.youtube.com/watch?v=W4FHlza1fRs

Here’s how it works…

Kapso has a bank of lessons that are induced or deduced from the past experiments, and each carries a credence score, conditions on where it applies, and the evidence behind it.  For each new experiment, an ideation module proposes ideas considering the earlier lessons, re-ranks them by expected return against the budget each would use, and sends the top-ranked ones to the implementor. Because the bank keeps learning from the past experiments in that environment, the proposed ideas are better suited to it than generic hypotheses from an LLM or RAG. Also, results of each experiment are verified by a verifier module that no experiment can access and cheat. As we’ve found when building such systems, sometimes the success criteria and evaluation tests need to be evolved. The experimentation modules can propose updates to the metrics and criteria for the verifier to approve or reject.

After each run, learn() updates the bank of lessons’ scores and boundaries using the evidence from that run. Changes to the bank can also be A/B tested by running otherwise identical builds with the previous and updated banks. The bank is built on git, so you can share your experience with others, list the banks available to you, and update them (`kapso experience share/list/update` in CLI). The system is model-agnostic and coding-agent-agnostic.

kapso.deploy(solution, target_stack) follows the same workflow, runs a shorter experimentation loop to adapt the best solution to the target stack (e.g. Docker, Modal, BentoCloud, LangGraph). Every domain has a harness to start from, you can write your own domain harness with /kapso:harness in the plugin or through CLI (kapso harness new <name>), and compound over that by running experimentations.

We ran it on some public benchmarks and live competitions, with the following results…

- Predictive modelling on relational databases: first on RelBench, Kumo AI (now Nvidia) and Stanford's benchmark, ahead of the best tabular foundation model (https://star-project.stanford.edu/relbench/leaderboard/). This shows that keeping the learning in the harness-level can beat foundational table models. Updating a bank of lessons costs far less than retraining a tabular foundation model.

- ML Engineering: First on OpenAI's MLE-bench at submission, still among the top open-source systems (https://github.com/openai/mle-bench/pull/107).

- AI competitions: ahead of the best agent the ALE-Bench authors at Sakana AI reported, and running autonomously at the live International Olympiad in AI 2026, above all 471 human contestants and in the top three AI systems (https://ioai-official.org/ai-models-track/ioai%c2%b2-2026-report/).

We have a public bank for ML and Data at Leeroopedia (https://leeroopedia.com/): around 100k pages extracted by experimenting on papers and repos, about 6M requests a month, about 28% from AI agents.

We would like to get your feedbacks on how to improve our learning!


r/learnmachinelearning • • 1h ago

B.Pharm student looking for help with a CNN-based project in Pharmacognosy!

1 Upvotes

Hi everyone!

I'm a final-year B.Pharm student working on my final-year project in Pharmacognosy, and I've decided to explore using Convolutional Neural Networks (CNNs) to detect adulterants in powdered crude drugs through microscopic images.

The idea is to train an image classification model that can distinguish genuine crude drugs from adulterated samples, potentially making herbal drug quality control more efficient.

Here's the catch: I'm a complete beginner when it comes to coding and machine learning!

I've tried a small experiment on Google Colab (black pepper vs. papaya seeds), but I have a LOT to learn.

I'm looking for help from:

  • IT/CS students or professionals familiar with Python, CNNs, and image classification.
  • Anyone experienced with machine learning, microscopy, or image datasets.
  • Pharmacy/Pharmacognosy researchers who could offer guidance on the scientific side.

I'm willing to put in the work and learn. I'm not expecting anyone to do the project for me; even a little guidance, useful resources, research papers or suggestions would mean a lot.

I have around 7 months to work on this, and I'd love to connect with anyone who might be interested in helping me navigate this journey.

Any help is genuinely appreciated. Thank you! :)


r/learnmachinelearning • • 2h ago

Highschool student , need guidance and direction

2 Upvotes

Hey, I am a grade 11 student that wants to build a ML model for a extracurriculars for university.

I am already comfortable with basic fundamentals of programming such as lists, loops, functions n variables, logic and I also know file handling, errror handling and object oriented programming in python.

I want to know what should I learn next. So that I can eventually be enough skilled to build a ML model


r/learnmachinelearning • • 3h ago

How important system design knowledge is for entry level roles..??

Thumbnail reddit.com
1 Upvotes

r/learnmachinelearning • • 3h ago

Request Ai Ml Dl resources

2 Upvotes

Can anybody suggest me a few aiml and dl resources to learn from scratch , I am a btech 2nd year student and I know python (excluding the modules)

And also a few projects which I can use to improve my thinking ability to implement the concepts


r/learnmachinelearning • • 4h ago

Help Complete Roadmap for AI/ML, Deep Learning, RL, LLMs, NLP and Multimodal AI

3 Upvotes

Hi everyone,

I want to build a career in AI/ML research and development, particularly in these areas:

Machine Learning and Deep Learning

Reinforcement Learning

LLMs and Generative AI

NLP

Computer Vision

Multimodal AI

Embodied AI

I want to master Python from fundamentals to advanced levels.

My questions are:

Which Python concepts should I master for these fields?

How deeply should I learn OOP, DSA, decorators, generators, asynchronous programming and memory management?

Which libraries and frameworks should I focus on (NumPy, Pandas, SciPy, Scikit-learn, PyTorch, TensorFlow, Hugging Face, etc.)?

What mathematics and Python skills are essential for implementing research papers?

What projects should I build, from beginner to advanced research level?

What is the ideal roadmap to become research-ready in these domains?

I'd appreciate recommendations for courses, books, documentation and practical resources.

Thanks in advance!


r/learnmachinelearning • • 5h ago

Discussion i started ml last week as an intermediate web developer! not sure if im even improving?

Thumbnail reddit.com
1 Upvotes

r/learnmachinelearning • • 5h ago

I made a tutorial covering some really cool Computer Vision architectures

Thumbnail
youtu.be
2 Upvotes

Video covers:

  1. Photo library search, text removal, label generation
  2. Document layout detection models and RT-DETR (D-Fine) architectures
  3. Tennis ball, player, courtmap tracking system with CenterMap-style heatmap prediction
  4. And my favourite: World Models/Neural Computers with VQ-VAE + Spatio-temporal Transformers

Project repo: https://github.com/avbiswas/computer_vision_recipes

Video: https://youtu.be/mPmdI-0ISx4


r/learnmachinelearning • • 9h ago

Request AI Joins the Industrial Attack Workflow - Recorded Future

1 Upvotes

Recorded Future published a report this week documenting AI agents actively participating in industrial cyberattack workflows — not as an emerging risk, but as a current operational pattern they're observing in the wild.

The shift that stands out: threat actors are deploying agents that autonomously sequence attack steps, pivot across systems, and exfiltrate data without waiting for a human operator to approve each move. The agent acts. Then it acts again. The human reviews logs later.

This creates a speed asymmetry that most enterprise security architectures weren't designed for. A compromised or weaponized agent can chain multiple tool calls — lateral movement, credential access, data staging — before a SOC alert even fires. By the time a human sees the first indicator, the second and third actions have already landed.

The Recorded Future finding is notable because it moves this from theoretical red-team scenario to documented adversarial tradecraft. Industrial environments are a specific concern because the blast radius of autonomous action on OT/ICS adjacent systems is not the same as a misconfigured S3 bucket.

For those working in enterprise security or agentic AI deployment: how are you currently handling the gap between when an agent takes an action and when a human can evaluate whether that action was legitimate? Curious whether teams are approaching this at the network layer, the orchestration layer, somewhere else, or accepting that the detection window is just going to be longer for autonomous workloads.


r/learnmachinelearning • • 10h ago

I built a local Qwen3.5-9B lossless Arithmetic Coding visualizer (vs zlib -9) — watching pretraining memorization vs. real generalization live

2 Upvotes

Inspired by 3Blue1Brown's information-theory video and Giacomo Magnanini's pdoom-video visualizer, I built a local Python + llama-cpp-python pipeline on a single RTX 4060 (8 GB) that compresses song lyrics with exact 62-bit lossless arithmetic coding using Qwen3.5-9B-Base (Q4_K_S GGUF) softmax CDFs, verifies 100% lossless round-trip decompression via SHA-256, and renders the live probability intervals & bitstream side-by-side against traditional zlib -9 (ZIP).

What surprised me most is how clearly pretraining memorization vs. real generalization shows up in bits-per-byte:

• Rick Astley – Never Gonna Give You Up (video above): 1,777 B → 45 B LLM (0.20 bpb · 39.5×) vs 358 B ZIP (7.96× smaller — almost pure memorization; whole lines collapse to ~0 bits) • Queen – Bohemian Rhapsody: 1,864 B → 77 B LLM (0.33 bpb · 24.2×) vs 831 B ZIP (10.79× smaller) • Daft Punk – Around the World: 2,519 B → 29 B LLM (0.09 bpb · 86.9×) vs 53 B ZIP (1.83× smaller) • Eminem – Rap God (1,542 words): 7,755 B → 1,284 B LLM (1.32 bpb) vs 3,752 B ZIP (2.92× smaller) • A Capella Science – Evo-Devo (less-memorized biology parody): 2,962 B → 610 B LLM (1.65 bpb) vs 1,538 B ZIP (2.52× smaller) • I'm Upping My P(doom) (newer / out-of-distribution generalization benchmark): 1,326 B → 294 B LLM (1.77 bpb) vs 772 B ZIP (2.63× smaller)

How it works:

  1. Word-level alignment: faster-whisper large-v3 (CUDA int8_float16) + monotonic DP over ground-truth lyrics.
  2. Exact lossless arithmetic coding: single-pass Qwen3.5-9B-Base.Q4_K_S via llama-cpp-python (float64 softmax -> monotonic int64 CDF + 62-bit integer arithmetic coder + SHA-256 decode verification).
  3. Live rendering: 2-worker Playwright Chromium RGBA Canvas2D stream piped into ffmpeg at 1080p60 / 4K60.

Full-length videos & code: • Realistic generalization benchmark — P(doom) (4K60, 294 B): https://youtu.be/SdPMF5OY_U0 • Memorization extreme — Rick Roll full song (45 B): https://youtu.be/gH8xmJAJaKo • MIT-licensed fork: https://github.com/TryCatchIgnoreDev/pdoom-video


r/learnmachinelearning • • 10h ago

Evolution of the 2D Walker | Vilvik Optimization in the Cloud

0 Upvotes

Evolution designs a car to drive over rough ground. Its genes are the car's body, wheels and motor.

The first cars are random and get stuck early. Over the generations the cars change shape and drive farther and farther.

Try this demo free at https://vilvik.com


r/learnmachinelearning • • 13h ago

Request WhatsApp Patches 3 Security Flaws, Including Android Bug Suspected of Use in Scams

1 Upvotes

WhatsApp patched three security vulnerabilities this week, including an Android flaw researchers suspect was actively exploited in scams.

The patch addresses the mobile surface. It does not address what happens when agents run over that surface.

Automated pipelines increasingly use WhatsApp, Telegram, and similar messaging platforms as their operational layer. Customer service agents, workflow bots, and agentic finance tools receive and act on messages through these channels. A vulnerability in the channel is a vulnerability in everything the agent does based on what comes through it. The agent has no way to know the input was manipulated. When a human gets a scam message, they can pause. An agent executes.

The three patched flaws are a concrete instance of a broader unresolved problem. Messaging platform CVEs are written from a user threat model, not an agent threat model. The fix stops the user-side exploit. It says nothing about what an agent already did while exploitation was live.

For teams running agents over messaging infrastructure: what does your posture look like when the compromise is at the channel level rather than the agent level? Are you catching this before actions fire, after the fact, or not at all?


r/learnmachinelearning • • 14h ago

Help I want to seriously get into ML/AI engineering and research. How would you approach learning it from scratch today

10 Upvotes

Hello everyone hope you are well, I know this is a lot but I'd appreciate the help.

I'm looking to seriously get into machine learning, AI engineering, and eventually research, and I'd appreciate some advice from people who are already working or studying in these fields.

I have a programming background and know the basics of Python. I've studied mathematics before, but I'm rusty and will need to revisit linear algebra, calculus, probability, and statistics.

I'm not looking for shortcuts or a guaranteed job roadmap. I'm trying to figure out how to spend my time effectively, build meaningful projects, and avoid tutorial hell.

I'm willing to dedicate 20+ hours a week to learning, and I'm approaching this as a long-term commitment rather than trying to land an AI job in a few months.

My goal is to actually understand how ML works, from the mathematics and algorithms to training models, experimenting, and eventually reading and implementing research papers.

I also want to build things throughout the learning process, rather than spending months watching tutorials and copying projects without understanding them.

I've started putting together a roadmap that begins with Python, NumPy, and mathematics, then moves into classical ML, deep learning, PyTorch, and eventually ML engineering and research.

But before committing to it, I'd really appreciate some perspectives:

  1. If you were starting ML from scratch today, what would your learning path look like? What would you prioritize, and what would you avoid?
  2. What books, documentation, or other resources helped you actually understand ML? I'm particularly interested in books and hands-on learning rather than relying entirely on video courses.
  3. What projects should a beginner build to develop real understanding? I'm not looking for projects that just look impressive on GitHub. I want projects that force me to understand the algorithms, mathematics, training process, and evaluation.
  4. How do you transition from learning ML to doing research? When should someone start reading papers, reproducing experiments, or investigating their own research questions?
  5. What separates someone who has completed ML courses from someone who is actually ready for an entry-level ML engineering or research engineering opportunity? What skills and evidence of ability do employers or researchers look for?
  6. How important is traditional software/backend engineering knowledge for ML engineering? Should I study it alongside ML, or focus on the ML fundamentals first?

My long-term goal is to become technically competent enough to contribute to real AI/ML projects, collaborate with experienced engineers and researchers, and hopefully work professionally in the field.

I'd especially appreciate hearing from ML engineers, research engineers, researchers, or people who have successfully made this transition.

Thank you all very much!


r/learnmachinelearning • • 14h ago

Sm_120 RTX 5070 causal conv1d and Ssm wheels

0 Upvotes

RTX 5070/5080/5090 (sm_120, compute 12.0) currently fails with "no kernel image is available" because setup.py only builds for 70;80;90.

I built working wheels for Blackwell:

- Patch: TORCH_CUDA_ARCH_LIST=12.0 and replace sm_70/sm_80/sm_90 with sm_120 in setup.py

- Tested on 5070 WSL2 + torch 2.11.0+cu128 + py3.10

- Wheels here for anyone stuck: https://github.com/Rapa2026/mamba-ssm-5070-blackwell-wheels

Happy to PR the sm_120 fix if you want it.

Test: Mamba2(d_model=64).cuda() -> OK


r/learnmachinelearning • • 14h ago

Before trusting a model score, check where preprocessing was fitted

0 Upvotes

A useful beginner check for a suspiciously good validation score: did preprocessing learn from held-out data?

Split first. Fit the scaler, imputer or feature selector on training data only, then transform the test data using that fitted step. For cross-validation, pass the whole preprocessing-plus-model Pipeline into cross-validation rather than preprocessing the full dataset first.

The scikit-learn guide demonstrates the trap with feature selection: an impressive score can appear even with random targets if test information leaks into training.

Source and examples: https://scikit-learn.org/stable/common_pitfalls.html

Which preprocessing step first made leakage click for you?

AI-assisted learning note, checked against the linked documentation. Not a personal experiment.


r/learnmachinelearning • • 14h ago

Tutorial I have created a video on how to build small language models

Thumbnail
youtu.be
1 Upvotes

I would love to get your feedbacks guys


r/learnmachinelearning • • 15h ago

I built LightsToFlag, an F1 race predictor in Python and Streamlit. Tonight’s Vegas pick: Verstappen from P2

4 Upvotes

What my project does
LightsToFlag predicts the full finishing order of the next F1 race and gives each driver a win, podium and top-10 chance from 5,000 simulated races.

  • Data: race results and grids from the free Jolpica F1 API
  • Model: a scikit-learn gradient-boosting model trained on 2022–2026 results
  • App: a Streamlit dashboard with a race list, season charts in Plotly, editable “what-if” grids for penalties, a chat page to ask questions about the data, and synthesized engine sounds

Target audience
F1 fans who like data, and anyone learning ML who wants a real-world project. It’s a learning project, not betting advice.

Comparison / what I learned
I tested it fairly: each race is predicted using only earlier races, and 10 races were held back for a final check. On those:

  • The tuned model got 83% of podium finishers right, against 60% for “everyone finishes where they start.”
  • Picking the winner barely beats “pole wins” (6/10 vs 7/10). Results data alone can’t do much better than that.
  • Leaving crashes and breakdowns out of training was the single biggest improvement.
  • My win percentages were too cautious. Calibrating the simulation’s randomness made them more honest on the held-out races too.
  • I also tried a LightGBM ranking model. Alone it was worse, and blended with the original it only tied on the held-out races, so I didn’t ship it.

Tonight (Las Vegas GP): Verstappen 45% from P2, Antonelli 33% from pole. I’ll report back after the race.

Feedback is welcome, especially ideas for adding practice pace with FastF1.


r/learnmachinelearning • • 17h ago

Deep Learning Explained with a Simple Example | How Do Neural Networks Learn?

1 Upvotes

Ever wondered how AI learns to recognize images, understand speech, and identify objects?

In this short video, I explain Deep Learning and Artificial Neural Networks using a simple example.

You'll learn how multiple layers in a neural network identify patterns and help AI make predictions.

🎥 Watch the short video:
https://youtube.com/shorts/JcBLPRz5TZc

I'm sharing educational content about AI, Machine Learning, and modern technologies through Zahid Labs.

Hope this helps beginners understand Deep Learning!


r/learnmachinelearning • • 17h ago

Help DS /ML- Refresher Resources

Thumbnail reddit.com
1 Upvotes

r/learnmachinelearning • • 18h ago

Does it really take this much to make it even as an AI semi-professional?

Thumbnail gallery
36 Upvotes

Hi there, I have a simple question, I came across purporting to present an appropriate AI roadmap, I will attach images.

Does it really take this much? Must I learn all this to consider myself educated in the matter? Or to get a job in the field?

There was much more. In any case, if anyone has a better alternative, please let me know.


r/learnmachinelearning • • 20h ago

Looking for a study buddy for DSA, System Design & Al System Design

2 Upvotes

Hey folks!

I'm a working professional with \*\*10+ years of experience\*\*, having a \*\*M.Tech in Al from one of the IIT\*\*. Planning to switch jobs in the next 6 months and looking for someone with a similar goal to prepare together.

Planning to focus on:

  1. DSA and problem solving
  2. System Design
  3. Al System Design

Looking for fellow working professionals who are seriously preparing for a switch. We can keep each other accountable, set weekly targets, discuss problems, practice mock interviews, and share resources.

Would prefer someone from \*\*Odisha\*\* (Bhubaneswar/Cuttack would be great), but that's not a requirement.

If you're in the same boat, drop a comment or DM. Let's keep each other consistent!


r/learnmachinelearning • • 20h ago

Do you guys have jobs or you got laid off?

0 Upvotes

r/learnmachinelearning • • 20h ago

Looking for a few like-minded people to learn AI engineering together

12 Upvotes

Hey everyone! I've been out of a tech job for a while and I'm getting back into it by learning AI properly, with the goal of becoming an AI engineer. Python first, then LLMs, RAG, agents, deploying projects, all of it. I've put together a roadmap and I'm aiming to finish it in 4 to 6 months, or however long it takes.

I'm not trying to start a big group or anything. I just think I'd stay way more consistent with a couple of people who are on the same page and want to upgrade their careers too.

If that sounds like you, just message me. We can have a quick chat, see if we click, and then decide if it makes sense to learn together.


r/learnmachinelearning • • 21h ago

Should I start with Data Science or Backend Development to get into ML?

9 Upvotes

I want to get into Machine Learning, and I'm not sure where to start. Should I learn Data Science first (data analysis, stats, training models) or Backend Development first ?(APIs, databases, software engineering)

For people already working in ML, which path do you think makes it easier to break into the field?