r/MLQuestions • u/ysjSouth_Pollution_ • 1h ago
r/MLQuestions • u/Inevitable-Doubt2399 • 3h ago
Beginner question 👶 Ai Ml Dl resources
reddit.comr/MLQuestions • u/Mysterious_Guava3663 • 5h ago
Beginner question 👶 i started ml last week as an intermediate web developer! not sure if im even improving?
reddit.comr/MLQuestions • u/No-Introduction-441 • 14h ago
Beginner question 👶 I want to seriously get into ML/AI engineering and research. How would you approach learning it from scratch today?
Hello everyone hope you are well, I know this is a lot but I'd appreciate the help.
I'm looking to seriously get into machine learning, AI engineering, and eventually research, and I'd appreciate some advice from people who are already working or studying in these fields.
I have a programming background and know the basics of Python. I've studied mathematics before, but I'm rusty and will need to revisit linear algebra, calculus, probability, and statistics.
I'm not looking for shortcuts or a guaranteed job roadmap. I'm trying to figure out how to spend my time effectively, build meaningful projects, and avoid tutorial hell.
I'm willing to dedicate 20+ hours a week to learning, and I'm approaching this as a long-term commitment rather than trying to land an AI job in a few months.
My goal is to actually understand how ML works, from the mathematics and algorithms to training models, experimenting, and eventually reading and implementing research papers.
I also want to build things throughout the learning process, rather than spending months watching tutorials and copying projects without understanding them.
I've started putting together a roadmap that begins with Python, NumPy, and mathematics, then moves into classical ML, deep learning, PyTorch, and eventually ML engineering and research.
But before committing to it, I'd really appreciate some perspectives:
- If you were starting ML from scratch today, what would your learning path look like? What would you prioritize, and what would you avoid?
- What books, documentation, or other resources helped you actually understand ML? I'm particularly interested in books and hands-on learning rather than relying entirely on video courses.
- What projects should a beginner build to develop real understanding? I'm not looking for projects that just look impressive on GitHub. I want projects that force me to understand the algorithms, mathematics, training process, and evaluation.
- How do you transition from learning ML to doing research? When should someone start reading papers, reproducing experiments, or investigating their own research questions?
- What separates someone who has completed ML courses from someone who is actually ready for an entry-level ML engineering or research engineering opportunity? What skills and evidence of ability do employers or researchers look for?
- How important is traditional software/backend engineering knowledge for ML engineering? Should I study it alongside ML, or focus on the ML fundamentals first?
My long-term goal is to become technically competent enough to contribute to real AI/ML projects, collaborate with experienced engineers and researchers, and hopefully work professionally in the field.
I'd especially appreciate hearing from ML engineers, research engineers, researchers, or people who have successfully made this transition.
Thank you all very much!
r/MLQuestions • u/Clause_8 • 1d ago
Beginner question 👶 Are there effective frameworks for using AI?
I use generative AI almost every day, and have found that it improves the quality of my work. However, hearing about the Reimann hypothesis proof, I'm wondering if I'm doing things wrong, since the level of improvement I'm seeing definitely isn't on the level of solve century old holy grail of mathematics. Does anyone have any recommendations as to effective frameworks for ways of getting the maximum benefit from generative AI, preferably from peer reviewed research which actually measures the improvement and indicates any tradeoffs (e.g., productivity versus accuracy)?
r/MLQuestions • u/CerealConMiel • 1d ago
Beginner question 👶 Does computing Group_size on train+test (no target) cause leakage? Reviewing a method from a Medium article
python.plainenglish.ioHi everyone,
I'm working on the Spaceship Titanic competition and I'd like to get your opinion on a feature engineering decision that appears in a popular Medium article. I want to check whether the method is sound or if it introduces data leakage.
Reference article:
The issue: Kaggle splits passengers randomly between train and test, so some groups are split across both sets. If `Group_size` (number of passengers in the same group, extracted from `PassengerId`, e.g. `0001_01`, `0001_02` belong to group `0001`) is computed separately in train and test:
# In train
train['Group_size'] = train['Group'].map(train['Group'].value_counts())
# In test
test['Group_size'] = test['Group'].map(test['Group'].value_counts())
...the same group can get different sizes in train and test. Example: group `0001` has 3 members total (2 in train, 1 in test) → train says `Group_size = 2`, test says `Group_size = 1`. Inconsistent, and neither reflects the true size.
The alternative (which I believe the article uses, or something similar) is to compute group sizes using train + test together, without touching the target:
all_df = pd.concat([train, test], ignore_index=True)
all_df['Group_size'] = all_df.groupby('Group')['PassengerId'].transform('count')
train = all_df.iloc[:len(train)].copy()
test = all_df.iloc[len(train):].copy()
This makes `Group_size` consistent and reflects the real group size.
My questions:
- Is computing `Group_size` on train+test (excluding `Transported`) considered data leakage? My reasoning is no: it only uses `PassengerId`/`Group` (identifiers), never the target. The group size is a real-world fact, not a label being peeked at.
- Is this transductive feature engineering generally accepted in Kaggle competitions, or discouraged even when the target isn't involved?
- Does the same consistency issue apply to other derived features (`Deck`, `Side`, `CabinNum`, `FamilySize` from `Cabin`/`Name`)? Should those also be computed globally (train+test) to avoid train/test mismatch?
- Has anyone reviewed the preprocessing method in the article above? I'd appreciate feedback on whether it's a solid approach or if there are pitfalls (especially around the train/test split consistency).
I'd love to hear how experienced Kagglers handle this. Thanks in advance!
r/MLQuestions • u/MolocManager • 1d ago
Beginner question 👶 How do you evaluate open weight models (for personal use) vs picking whichever frontier model tops leaderboards?
Some friends and I are hacking on a few things to git gud at AI beyond the models everyone's already using. We're picking open weight models for a few real tasks, but the jobs are all over:
- structured extraction from various docs/assets, 2) classification or triage tasks, 3) Q&A querying your own materials like RAG, 4) templatized/structured summaries, 5) coding, 6) work in languages that aren’t English (use non-Roman alphabet). We've just been testing & debating but need some structure to move forward.
Public leaderboards haven’t helped much. Imo scores depend a lot on who runs the test and how, and the tests rarely look like my real work
SELECTION - How are you accessing the most relevant OS/OW models? Started with OpenRouter but some privacy ppl suggested NY Token Exchange or OmniRouter. Haven't set it up yet, unsure of what tradeoffs more private models have, like speed.
TESTING - Did you build your own test set from real tasks? How many examples did it take before you felt OK trusting the results? Where should I go for pre-built evals?
Reading recs are welcome as well, since I’m kinda new to this.
r/MLQuestions • u/everydayreligion1090 • 1d ago
Other ❓ Looking for 3 comprehensive courses to build strong foundations in AI, ML, and Deep Learning before starting projects
hi everyone
so im a computer science graduate looking to rebuild my foundations in artificial intelligence, machine learning, and deep learning
ive studied some of these subjects before but ive forgotten quite a bit so id like to start again with a structured learning path
my goal is simple
complete three comprehensive and affordable courses, one for each subject, and then start building projects, reading research papers, and conducting literature reviews
ideally im looking for
1 artificial intelligence fundamentals
a course covering the major concepts and branches of ai including classical ai, search algorithms, knowledge representation, reasoning, planning, and an introduction to modern ai
2 machine learning fundamentals
a course covering the major ml approaches including supervised learning, unsupervised learning, reinforcement learning, regression, classification, clustering, decision trees, ensemble methods, model evaluation, and other essential concepts
3 deep learning fundamentals
a course covering neural networks, backpropagation, optimization, cnns, rnns, lstms, attention, transformers, generative models, and other major deep learning architectures
my preferences
- coursera, edx, university courses, or any reputable platform
- courses must be affordable and preferably free or reasonably priced
- preferably taught by respected university professors or established ai researchers
- beginner friendly explanations but with enough technical depth to understand research papers
- a balance of theory, mathematics, and practical programming
- preferably one comprehensive course per subject but im open to specializations if a single course isnt sufficient
im not trying to become an expert in every ai subfield before starting projects
i just want a solid broad foundation so i can understand the terminology, read academic literature, conduct literature reviews, and independently learn more advanced subjects when needed
for those who have taken these courses which three would you recommend and why
id particularly appreciate recommendations based on firsthand experience including any important topics the courses leave out
thanks
r/MLQuestions • u/No-Act-8939 • 1d ago
Beginner question 👶 Where to get started?
reddit.comr/MLQuestions • u/jgcoelho_real • 2d ago
Beginner question 👶 How do I stop Gemma 26B E4B from behaving like this?
It gets the task right and then does not stop thinking ever. It goes something like this:
Writing result... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually finished everything in my head. Ready to provide the solution. Done! Go! Finished. Actual final end of thinking process. Writing... DONE! (Stop). End of thought cycle. Everything is correct. Proceeding to outputting response for the user. All instructions followed. Finalizing. Ready. Outputting now. (End). Thinking block complete. Final answer ready. DONE! (Stop). Actually [...]
I already tried including a line in system instructions to respond immediately after finding the answer, but it fails to steer it. It is a bummer that the model gets stuck like this, because it is actually better at writting than Qwen 35B A3B.
r/MLQuestions • u/Familiar9709 • 2d ago
Beginner question 👶 What is the purpose of cross validation, validation and test set?
What is the purpose of these different steps in building a machine learning model? Let's say you have X data points, how should you do the division into the different sets? Should it be 60/20/20? 60% to use for cross validation, 20% for test set and 20% for validation?
If so, what is the purpose of the test set if you already are doing the cross validation step where you take all that data, you make the folds and you test the models?
Unfortunately the information I could gather is quite contradicting and also doesn't consider sometimes the cross validation step, so would be very good if people could explain this in greater detail.
Thanks
r/MLQuestions • u/Cupcake_Timely • 3d ago
Beginner question 👶 The 3 dimensions of an AI system
r/MLQuestions • u/kamesh_singh • 3d ago
Beginner question 👶 Need advice on accurate golf ball tracking using computer vision
I'm trying to build a golf ball tracking app similar to Shot Tracer and SmoothSwing. I've experimented with several open-source AI models, but I haven't been able to achieve reliable tracking accuracy.
The ball is tiny and moves very fast, making it difficult to track consistently across video frames.
I'm looking for advice from people experienced in computer vision, object tracking or ML:
- What approaches/models work best for tracking tiny, fast-moving objects?
- Should I combine object detection with temporal tracking, optical flow or Kalman filters?
- Are there any specific models, datasets or research papers worth exploring?
I'm not looking for a basic YOLO implementation. I'd like to understand how to build a genuinely reliable tracking pipeline.
Any suggestions or experiences would be appreciated!
r/MLQuestions • u/Strict-Purple-2250 • 3d ago
Beginner question 👶 New to AI field
reddit.comr/MLQuestions • u/DetectiveNew8385 • 4d ago
Beginner question 👶 Guys can you explain backpropagation through time and normal backpropagation I am confused
r/MLQuestions • u/jcastroarnaud • 4d ago
Beginner question 👶 An idea for bias mitigation in LLMs. Would it work?
reddit.comr/MLQuestions • u/mr-goku1228 • 4d ago
Beginner question 👶 Want to learn ml at 16
So, I am 16 and I want to learn AI/ml for physical ai. Like robotics, simulation, VLA model (Vision-Language-Action). I learn python at an intermittent level I build some projects like my personal assistant Jarvis (not trained but used Chatgpt API). So, can anyone give me a roadmap or course that I should learn. Or even done tips. It would be very useful.
r/MLQuestions • u/boldbug-dev • 5d ago
Beginner question 👶 trying to make CNN from scratch but i cannot understand this specefic part
from PIL import Image
import matplotlib.pyplot as plt
from datasets import load_dataset
import numpy as np
# load the image
# image = Image.open("cat.jpg")
def preprocess_image(image):
image = image.convert("RGB")
image = image.resize((128, 128))
image = np.array(image).astype(np.float32) / 255.0
return image
# Load dataset in streaming mode
dataset = load_dataset(
"microsoft/cats_vs_dogs",
split="train",
streaming=True
)
images = []
labels = []
for sample in dataset.take(32):
images.append(preprocess_image(sample["image"]))
labels.append(sample["labels"])
X = np.array(images) #shape (1,32)
y = np.array(labels) #shape (1,32)
#fliters
filters = np.random.randn(64, 27) * 0.05
filters_2 = np.random.randn(32, 576) * 0.05
filters_3 = np.random.randn(16, 288) * 0.05
b = 0.0
stride = 1
pad = 0
all_feature_maps = []
for image in X[:1]:
#1st layer
feature_maps_1 = []
feature_maps_2 = []
feature_maps_3 = []
feature_maps_3_grids = []
for w in filters:
feature_map = np.zeros((126, 126))
for i in range(126):
for j in range(126):
a = image[i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_1.append(feature_map)
feature_maps_1 = np.array(feature_maps_1)
#2nd layer
for w in filters_2:
feature_map = np.zeros((124, 124))
for i in range(124):
for j in range(124):
a = feature_maps_1[:,i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_2.append(feature_map)
feature_maps_2 = np.array(feature_maps_2)
#3rd layer
for w in filters_3:
feature_map = np.zeros((122, 122))
for i in range(122):
for j in range(122):
a = feature_maps_2[:,i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_3_grids.append(feature_map)
feature_map = np.mean(feature_map) #global average pooling
feature_maps_3.append(feature_map)
all_feature_maps.append(feature_maps_3)
all_feature_maps = np.array(all_feature_maps)
feature_maps_3_grids = np.array(feature_maps_3_grids)
dense_weights = np.random.randn(16,2)* 0.01
dense_bias = np.zeros(2)
logits = all_feature_maps @ dense_weights + dense_bias
exp_values = np.exp(logits)
p = exp_values / np.sum(exp_values,axis=1,keepdims=True)
loss = -np.log(p[0, y[0]])
print(loss)
print(p)
d_logits = p.copy()
d_logits[0, y[0]] -= 1
print(d_logits)
grad_d_weights = all_feature_maps.T @ d_logits
grad_d_bias = np.sum(d_logits, axis=0)
print(grad_d_weights)
print(grad_d_bias)from PIL import Image
import matplotlib.pyplot as plt
from datasets import load_dataset
import numpy as np
# load the image
# image = Image.open("cat.jpg")
def preprocess_image(image):
image = image.convert("RGB")
image = image.resize((128, 128))
image = np.array(image).astype(np.float32) / 255.0
return image
# Load dataset in streaming mode
dataset = load_dataset(
"microsoft/cats_vs_dogs",
split="train",
streaming=True
)
images = []
labels = []
for sample in dataset.take(32):
images.append(preprocess_image(sample["image"]))
labels.append(sample["labels"])
X = np.array(images) #shape (1,32)
y = np.array(labels) #shape (1,32)
#fliters
filters = np.random.randn(64, 27) * 0.05
filters_2 = np.random.randn(32, 576) * 0.05
filters_3 = np.random.randn(16, 288) * 0.05
b = 0.0
stride = 1
pad = 0
all_feature_maps = []
for image in X[:1]:
#1st layer
feature_maps_1 = []
feature_maps_2 = []
feature_maps_3 = []
feature_maps_3_grids = []
for w in filters:
feature_map = np.zeros((126, 126))
for i in range(126):
for j in range(126):
a = image[i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_1.append(feature_map)
feature_maps_1 = np.array(feature_maps_1)
#2nd layer
for w in filters_2:
feature_map = np.zeros((124, 124))
for i in range(124):
for j in range(124):
a = feature_maps_1[:,i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_2.append(feature_map)
feature_maps_2 = np.array(feature_maps_2)
#3rd layer
for w in filters_3:
feature_map = np.zeros((122, 122))
for i in range(122):
for j in range(122):
a = feature_maps_2[:,i:i+3, j:j+3].flatten()
z = np.dot(w, a) + b
feature_map[i, j] = z
feature_map = np.maximum(feature_map, 0) #ReLU
feature_maps_3_grids.append(feature_map)
feature_map = np.mean(feature_map) #global average pooling
feature_maps_3.append(feature_map)
all_feature_maps.append(feature_maps_3)
all_feature_maps = np.array(all_feature_maps)
feature_maps_3_grids = np.array(feature_maps_3_grids)
dense_weights = np.random.randn(16,2)* 0.01
dense_bias = np.zeros(2)
logits = all_feature_maps @ dense_weights + dense_bias
exp_values = np.exp(logits)
p = exp_values / np.sum(exp_values,axis=1,keepdims=True)
loss = -np.log(p[0, y[0]])
print(loss)
print(p)
d_logits = p.copy()
d_logits[0, y[0]] -= 1
print(d_logits)
grad_d_weights = all_feature_maps.T @ d_logits
grad_d_bias = np.sum(d_logits, axis=0)
print(grad_d_weights)
print(grad_d_bias)so i don't understand
- why is d_logits even needed and what is it?
- why does multiplying d_logits the transpose of 16 pooled features gives us the gradient for dense weights
- why is grad of bias just sum of d_logits?
( i tried asking LLMs but they give too complex answers or start giving code which i don't want and cannot understand)
and most importantly what do i do next and how to move further and backprop on CNN?
any additional tips will be appreciated!
r/MLQuestions • u/Imaginary-Bee-8770 • 5d ago
Career question 💼 Moving from Agents into Machine Learning...
reddit.comr/MLQuestions • u/DKAIN_001 • 5d ago
Beginner question 👶 How to do model evaluation and diagnostics?
reddit.comr/MLQuestions • u/Resident-Apricot3212 • 6d ago
Beginner question 👶 Xgboost models fails to capture dynamics across training data batches.
Hi everyone, I have an mlr3 based toolset in R for regression models for process sensor time series data. This is my largest project to date with roughly 30 input features that are also lagged and rolled to inject temporal memory. Due to the difficulty of carefully weighting training size on a 1 minute sampling rate vs. relative weight of dynamic changes I switched to a batching scheme and now use LOBO on currently 4 train batches. This is just a pilot mode plot where it only trains on 5-10% of input data so feature to data point ratio is less than ideal. The result of a full run is the same though.
Hyperband tunes nrounds 16-512 with eta 2-3 for an xgboost model. The result is a strong deviation from baseline, extremely low skill against persistence and xgboost mostly hunting to find some sort of baseline with strong bias rather than capturing any dynamics. Although persistence is overly optimistic here as target is dampened by some technical details independent of data handling. This is accounted for as best as possible by injected retention time and holdup features. Target and features are real on-stream data.
How do I best proceed from here? I feel like I am missing something because rolling window cross validation within batch produced much better results but missed the optimization goal of optimizing across batches. Right now I take great care in preserving temporal alignment across batches and index data to preserve integrity across batches.
```
INFO [22:03:49.004] [bbotk] Finished optimizing after 69 evaluation(s)
INFO [22:03:49.007] [bbotk] Result:
INFO [22:03:49.015] [bbotk] eta max_depth min_child_weight lambda subsample colsample_bytree
INFO [22:03:49.015] [bbotk] <num> <int> <num> <num> <num> <num>
INFO [22:03:49.015] [bbotk] -3.398853 3 1.909219 -0.775668 0.8 0.8
INFO [22:03:49.015] [bbotk] nrounds x_domain objective
INFO [22:03:49.015] [bbotk] <num> <list> <num>
INFO [22:03:49.015] [bbotk] 19 <list[7]> 26.70044
```
r/MLQuestions • u/Datu1423 • 6d ago
Beginner question 👶 Anyone working in AML / transaction monitoring / sanctions screening using ML? Looking for advice on where to start [R]
reddit.comr/MLQuestions • u/hairypulsehack • 6d ago
Hardware 🖥️ Training hardware
Hi,
So I've been studying deep learning for some time now, and I joined a research group doing some time series stuff. Unfortunately I think training on CPU is becoming a huge bottleneck both for me dicking around at home and my research projects.
I've been doing networks small enough that I could just do it in the CPU, however I'm incorporating more data, and more complex cnns. I want to train one with about 3 million parameters, but it takes an hour per epoch basically. Additionally, I think in my own time I want to train an agent to play a game, (like one of the Source or goldsrc games) just sounds cool.
I have an rx 480 (AMD Polaris) right now, so it's probably time to upgrade anyways.
I am looking at a quadro rtx 5000, since it's under 500 on eBay. But I'm not sure what to get and the market seems batshit insane right now, I'm not interested in paying the gamer tax either and hoping to snag a deal on some accelerator card or some other enterprise card.
Budget ~500 usd. I don't think I care about vram since I won't be hosting an LLM but I could be wrong? I don't know much about hardware presently, I want to learn though and my card is basically deprecated or not supported on everything lol.