r/AskStatistics • • 10h ago

Statistics in Statistics vs Engineering vs Economics program: How are they different and what is the best way to study statistics "proportionally"?

6 Upvotes

Hello, I'm planning to get into economics master's program and wondering how to approach statistics correctly.

As a background, I'm working as an analytics lead and quite familiar with programming and statistics. But most of my skills are either self-taught or a result of bootcamp training.

In Python, you can simply use pandas, numpy, and other kinds of library to solve statistics problem. It provides you with most of methods you'd ever wanted for data analysis. However, to be a better analyst you must understand how they work under the hood, like how pandas stores the data as dataframe. By doing so, you can easily grasp other related concepts in pandas like type casting, grouping, lambda, etc.

But once you got deeper in Python, new concepts start to appear. While concept like class and dunder methods is useful and used widely, I don't think it is important to learn how to use abstract based class as an analyst and better let the engineers handle it. I may be wrong here, but, you know, you better use your time for something else instead of studying everything at once.

Bringing it back to the main questions, I can spend time to learn the statistics behind each probability distributions. But I'm not sure at which point this becomes unproductive for the purpose of my study


r/AskStatistics • • 18m ago

Honest opinions on my end-of-the-year project topic? (Extreme Value Theory / Insurance)

0 Upvotes

Hi everyone, English isn’t my first language so sorry if anything sounds weird. I’m studying Applied Statistics and Probability and working on my end-of-the-year project. My teacher gave me a topic on "Modeling Severe Claims Using Extreme Value Theory", I started working on it, but I'm having some doubts. I’ve studied things like time series, Bayesian inference, and nonparametric estimation, so I just wanted to ask what you really think—is this actually a good topic or not?


r/AskStatistics • • 2h ago

Statistical analysis between two Likert scale-type questions?

1 Upvotes

I'm a qualitative social sciences student hoping to branch out into some statistical analysis, and learning as I go. I'm pitching a survey that has a 3-point likelihood question (not, somewhat, very likely) that I'm hoping to compare to how they rate the level of importance of a different variable (either a 3- or 5-point scale).

I would very much appreciate any suggestions for how to analyze this data. I was looking at a Spearman correlation (I expect the data to be non parametric). Am I on the right track and/or are there other types of analyses I should research for this? TIA!!


r/AskStatistics • • 16h ago

Comparing MLE statistics across groups

3 Upvotes

I have 50 seismic regions that divide the world’s earthquakes, and I would like to know if the b-value (a MLE based on the magnitude distribution of quakes) differs based on region. For each region I have the b-value itself as well as a boot strapped standard deviation. What are my options for meaningfully answering this question?


r/AskStatistics • • 14h ago

What objective criteria separate "completed easily" from "completed with difficulty"?

2 Upvotes

I'm running a usability evaluation of standard web tasks, such as account creation and finding prices, across several user groups. Each task is scored on a three-point scale: completed easily, completed with difficulty, or failed.

The challenge is the boundary between the first two. Users often finish only after reading through dense text or hunting for a buried call to action. Without clear criteria, one evaluator scores that as a success and another as difficulty, which makes my results inconsistent.

What established rubrics or thresholds (for example, time-on-task compared with a baseline, misclick counts, or specific behavioral signs) work best for telling easy completion apart from completion with difficulty?


r/AskStatistics • • 21h ago

Update: problem with controls Im mediation analysis

Thumbnail gallery
2 Upvotes

Heyo y’all, I think I figured out how to get Jamovi to run and display a mediation analysis with controls through jaMM. When you add controls to the study it automatically puts them into the mediation box, however you can pull them out and readd them tho the full model for an accurate path analysis. You also have to deselect. Suggested paths at the bottom. The first picture is the statistical path model. The second is the conceptual path model. Any experts on mediation: does this look mathematically correct?


r/AskStatistics • • 20h ago

First post on reddit, uh I have a statistics problem

0 Upvotes

I live at point H, which is exactly a 7-minute walk from two train stations, Station A and Station B.

The three points form a right-isosceles triangle, with H as the 90° angle. Stations A and B are connected by the train line, which forms the hypotenuse.

The train travels along the route in this order:

A → B → C → D → E ...

Some additional information:

Trains arrive every 10 minutes.

The train travels at 20 mph.

It stops at each station for 50 seconds.

My destination is Station D.

Walking to either Station A or Station B takes exactly 7 minutes.

The train takes 2 minutes to travel from station A to B after leaving the station

The question:

Would it be more efficient to walk to Station A, which is earlier on the train route, or Station B, which is closer to my destination?

More specifically, does boarding at Station A give me any advantage in terms of the probability of catching a train, or is Station B mathematically the better choice since I have the same walking time but a shorter journey aboard the train?

Is there a mathematical way to determine which station is optimal?

Also, I've simplified the above problem a tad.

During rush hour, two trains run on the track. One only stops at station A, C, E, G, etc, wheras the other only stops at stations B, D, F, H, etc. (though both inevitably stop at my destination)

The same rules apply to them, meaning that Train 1 arrives at station A every ten minutes, and Train 2 arrives at station B every ten minutes.

Does this change the outcome of the problem?

Hopefully I can make my commute more efficient :)


r/AskStatistics • • 1d ago

Which statistical tests to proceed with?

Post image
3 Upvotes

I’m a newbie and am learning stats now. Which statistical tests should I proceed with? Do they data pass out for a normal distribution? Please guide me. Also, I guess this is considered to be independent as bacteria 1 and bacteria 2 groups are completely different controls of the same product (I mean nothing was reused but it’s the same product, we just had multiple of it).


r/AskStatistics • • 1d ago

How do I properly compare two randomized algorithms when the evaluation is random too?

4 Upvotes

Hello everyone,
This is my first time posting here, so I'm sorry if this isn't the right subreddit for this question. I'm working on a personal project on anonymizing graph data and trying to de-anonymize it. The issue is that I'm confused about how to evaluate my results properly, so I would really appreciate your advice.

I came across an existing anonymization algorithm, and I also wrote another algorithm myself. To test them, I used a de-anonymization algorithm to obtain the re-identification rate for each anonymized graph.

My main issue is that randomness shows up in several places.

First, it appears in the anonymization algorithm. Running it with the same input can give different valid output graphs each time, and a seed controls this. Meanwhile, my algorithm uses a parallel solver, so even with a fixed seed, I get different outputs.

Secondly, the re-identification attack also depends on a seed because it reorders the node IDs of the graph.

From my results, what I saw was:
- Attacking the same graph several times usually gives similar scores, but every now and then, a run comes out much higher. I tried 10 attacks per output, and in one case, the re-identification rate ranged from 0.4% to 16%.

- Different outputs from the same method vary a lot. I got three different outputs from the same input, with the same number of modifications, and their mean re-identification rates were 1%, 3%, and 59%.

My questions are:

  1. What is the right statistical approach I should follow?
  2. How do I decide how many graphs vs. how many attacks per graph I need? Is there a way to work that out from the variation I already have?
  3. Since the results are skewed with occasional big spikes. Should I be reporting the mean, the median, or something like the worst case?
  4. Does it matter that my method's randomness can't be controlled with a seed? Can I still treat the outputs as independent samples?

I'd really appreciate any advice or suggestions. Thanks in advance for any advice!


r/AskStatistics • • 1d ago

Hi, this has bugged me regarding scientific abstract articles -- any advice?

1 Upvotes

Sorry if this is the wrong sub. I am new here. This involves Statistics but I'm not exactly sure which sub to use. So here goes.....

It has bugged me that when I've studied personality/temperaments/careers/types/archetypes, it always seems to come down to this....

The author(s), in their abstract/article where they've conducted an academic or professional study upon a personality system/assessment such as the MBTI, or the Keirsey-Bates Temperament Sorter, or the Big 5 Personality Assessment, or the Buckingham-Clifton StrengthsFinder, or the MMPI-2, or such-and-such assessment, that they're always using Epsilons or Sigmas or Sample Size N, or such-and-such Margin of Error.

I've studied several of these tests/assessments, and I've been intrigued by them -- for one, the Buckingham-Clifton StrengthsFinder correctly told me that Deliberative is one of my strengths. But it taught me nothing else.

And so, the authors trump up their research with an abstract. I'm sorry, but I didn't earn a PhD and I haven't taken Statistics in quite a long time. And when I did, it wasn't extremely rigorous, like that I assume of PhDs.

Regarding all of these Sigmas and Epsilons and other variables (such as Margins of Error) and what-not, it confounds me. Give it to me straight: Do I have to take an advanced course in Statistics in order to make sense of all of these abstracts in science & medicine?

Perhaps I should cross-post to a Psychology sub or an HR-related sub?

Thank you


r/AskStatistics • • 2d ago

looking Advanced Causal Inference project work ideas

8 Upvotes

Hello there!
I'm attending an advanced causal inference course and I have to do a project work on Stata. As of now I have 0 ideas on the topic. The professor suggested to find a policy and start from there, but I'm having issues with finding a decent dataset.
If it was environment or climate related somehow it would be awesome since I'm enrolled in environmental economics (it's not mandatory though since the advanced course is elective). Any idea? thanks in advance 😄


r/AskStatistics • • 2d ago

Statistics for health sciences

1 Upvotes

I am really struggling with my statistics class. I practice over and over again, and I genuinely try my best to understand the material. One of the reasons I chose nursing was because I always thought math wouldn’t be such a big challenge in nursing, but statistics has been really difficult for me.
I make my own practice questions using Gemini, and I usually feel like I understand the concepts when I’m practicing. However, when I get to the exam, the questions are much harder, and the professor uses language that makes the questions even more confusing. I feel like I understand the material until I actually have to apply it to the exam questions.
I honestly don’t know what else I can do to improve. The final exam is worth 30%, and I’m feeling really overwhelmed. I scored below the class average on my last exam, and for the first time in my life, I’m below the class average in a course. It’s really discouraging.
Does anyone have any tips, resources, or advice for studying statistics for health sciences? I would really appreciate any help. 😭


r/AskStatistics • • 2d ago

Interpretation of a Cronbach’s alpha score of 0.92 for a measurement instrument

2 Upvotes

Hello :D I am working on an instrument to measure a psychological construct. It consists of 19 items and covers 4 dimensions. We also conducted a pilot test by administering it to 29 people. After collecting the responses, we calculated Cronbach’s alpha and obtained a value of .92. Someone suggested that it should be .70, but I have read elsewhere that anything above .85 is acceptable. I would appreciate your opinion on this.


r/AskStatistics • • 2d ago

Is becoming a Statistician a good idea? (for me)

1 Upvotes

I'm a 24 year old, from Australia, with a double degree in Economics and Applied Finance. I did alright throughout these studies but overall I regret studying these subjects, as I'm not that interested in commercial jobs or the subjects themselves.

For econometrics I had to go through some statistics courses, and they were the highlight of my university studies. Now looking and applying for jobs I think I would enjoy and be good at a data role, but the data-driven focus of a statistician seems more appealing to me than the theory-driven and commercial goal of an economist, and an econometrician seems out of my reach considering my lack of interest in economics now.

I think I'd be starting from almost nothing if I did pursue this career and think that it would take me a minimum of 3 years before I could start seriously pursuing a career as a statistician.

Just want to hear someone's opinion on this, thanks :)


r/AskStatistics • • 2d ago

How do I perform an a priori power analysis for multiple regression with two predictors using Jamovi?

1 Upvotes

Please help me T-T


r/AskStatistics • • 2d ago

Two way ANOVA violated assumptions

Thumbnail gallery
15 Upvotes

I am doing two two-way ANOVAS for my Dissertation as my DV is split in two (Positive Affect and Negative Affect combined as the DV 'emotional state'). However, some of my assumptions have failed (see images).

Context:

The study featured a 2x3 between subjects design with two independent variables (IVs): occupation (newsworker or non-newsworker) and news valence (negative, neutral or positive).

The outcome variable was emotional state (this was calculated with PANAS which is split into Positive Affect and Negative Affect so I had to do two separate two way ANOVAs hence the two plots).

Positive Affect was normally distributed; Shapiro-Wilk: W = 0.99, p = 0.74 and Q-Q plots and had equal variances; Levene's test: F(5, 57)=2.21, p = .066.

However, Negative Affect was not normally distributed; Shapiro-Wilk: W = 0.87, p = < .001. The Levene's test showed non-equal variances: F(5, 57)=5.04, p = <.001.

My supervisor said:

ANOVA can be reasonably robust to some departures from normality, but this does not mean that all assumption violations can be disregarded. I would recommend inspecting the residual distributions and Q-Q plots, checking for outliers and influential observations.

I could adjust my p value to be cautious but my effects in the ANOVA would still be significant.

However, as the assumption tests failed, is there anything else I can do? or is it just a case of stating they failed, explaining why, and acknowledging that the results should be looked at cautiously?

I have included some of my results and some of the output from SPSS.

I'm just really unsure of what to do following the assumptions failing.

Thank you.

EDIT: should I mention the large SDs?


r/AskStatistics • • 2d ago

Best way to study statistics/study tactics

2 Upvotes

Hi! I’ve been really struggling in statistics (college class) lately and I don’t know what to do. I’m more right-brained than anyone I’ve ever met and anything logistic-based flunks in my head. Creativity is all that I can do.

I’ve always had trouble with math and no matter how hard I study I can never get it right. I can pay attention in class, write notes, and do everything needed but it just doesn’t stick. Even with full focus. I’m worried it’s something with me like a learning disability because it’s really bad I’m going to fail my class. I’ve even talked to my teacher and there really is nothing that’s sticking. I don’t know if it’s bad luck with bad teachers but I’m really having trouble. I’ve been getting 100’s on all the homework because I’ve been testing myself and making sure everything is correct just to keep my grade a float. I need atleast a C- to pass the class and I do NOT want to take it again.

We have one test (correlation) left and then the big exam going over everything we’ve learned.

My teacher is one of those teachers that tries to be “funny” more than teaching so I think that’s one of the things making it hard for me.

I don’t have much time anymore either especially commuting and working so studying super late ruins my sleep schedule. I really am having it rough I’ve lost so many tears over this. Yes it’s just math but it’s important and I really can’t do it. 🫩

What do you guys suggest I do? How should I study? Thank you so much for reading and for your help.


r/AskStatistics • • 3d ago

Binomial distribution when number of trials not fixed?

4 Upvotes

Hi,

I’m dealing with a system that occasionally fails during power-up. Each trial has two possible outcomes: failure or success. My initial thought was to use a binomial distribution.

The assumptions seem to hold:

  • Two possible outcomes: Yes
  • Constant probability: As far as we know
  • Independent trials: Yes

My uncertainty is about the fixed number of trials requirement. We can choose how many trials to perform, but I’d prefer one continuous test session rather than repeated batches of, say, 5,000 trials. Does this still satisfy the requirement?

Also, the failure probability is unknown. So far, we’ve observed 3 failures in 10,000 trials. Since testing is time-consuming, I’d prefer not to run significantly more trials just to improve the probability estimate.

Would a binomial distribution be appropriate here, or would a Poisson distribution be better suited?

This is work related, and my background is electronics engineer fyi.

(could ofc use som bot to get an answer, but I dont trust em enough, and would rather be confident in my work, and learn things properly.)


r/AskStatistics • • 4d ago

Did everything "right", became a statistical analyst, got laid off. Is it worth it to stay on track or pivot completely, given the obviously foreboding circumstances we all face.

31 Upvotes

Hi all!

Thanks for reading.

I'm at a serious career crossroads and would really appreciate some honest perspective about what I might be able to do next.

As a bit of background, I got a B.S. in Mathematics and an M.S. in Statistics/Decision Theory and graduated in 2023. Got hired as a stats analyst at a reputable think tank at the beginning of 2024, where I worked with some amazing statisticians and economists on work in Medicaid studies and the likes. That is... until the axe fell. As a largely government-funded institution, devastating cuts to healthcare, socioeconomic research, DEI, etc., left a huge chunk of us either laid off immediately or facing the prospect of another year or so before ultimately joining the unfortunate many, myself included. Many who got laid off were considered prestigious researchers in their areas with 20+ years of experience.

Now I find myself in a brutal job market - limited opportunities, intense competition, and the imposing doom of AI in statistical analysis and data science. For example, I was recently a serious contender for an entry level analysis position requiring 2 years of experience but was pushed out by someone with 12+ years of experience. It's rough. So rough that I'm wondering if staying in this field is even feasible anymore.

I'm willing to pivot from research to pretty much anything within the field. I'll really miss contributing to meaningful work but let's face it, I have a family to feed, so to speak. That said, I'm also willing to put in the work to pivot further into, say IT infrastructure or something like that if the money is there and the certification process is not crazy. Heck, I'm even considering starting a house painting business.

I'd really appreciate some honest perspectives:

  • For those currently working in statistics or data science, how are you feeling about the job market and long-term prospectives?
  • Has anyone here successfully pivoted from stats to something different? How was the transition?
  • If you were in my position, would you continue pursuing statistics, invest in new technical skills, or seriously consider a different path altogether?

I'm not expecting anyone to make this decision for me. I'm just trying to seek inspiration as to where to direct my energy after months of shooting resumes into essentially a void. Thanks!!!


r/AskStatistics • • 4d ago

Harmonising logically dependent covariates before regression: iterative covariate-space approach or joint model of y and x?

3 Upvotes

I am building a regression model for a response y using several covariates that describe the same physical reality, namely the built environment. The covariates come from different sources, and they should be consistent with each other:

  • If there is a road, there should be impervious surface.
  • If there is impervious surface but no road, the road map may be incomplete (the road data come from OpenStreetMap, whose completeness varies).
  • If there is a building height, there should be impervious surface.

And so on for the other covariates.

In practice the sources are imperfect, so these relationships are often violated. A regression model such as a random forest or gradient boosting will handle this implicitly, through the predicted probability of y given the covariates. I wonder whether a more explicit, iterative process would work better. I see two options:

  1. Covariate space only: harmonise the covariates among themselves before the regression. For example, iteratively update each layer given the others until they are mutually consistent.
  2. Joint model of y and x: model the response and the covariates together, so that each constrains the other.

Some of the rules are firm (a building height implies impervious surface). Others are only probable (impervious surface without a road may be a car park, not a missing road).

If each option were formalised as a single, well-defined statistical procedure, which procedure would be the most appropriate for Option 1 and which for Option 2, given that the rules are a mix of firm and probable ones?


r/AskStatistics • • 4d ago

What to do with many categorial variables in regression?

7 Upvotes

Hi, I'm trying to do a regression analysis to find relationships between 16 nominal/ ordinal variables + 11 continuous variables and only 1 continuous dependent variable in SPSS.

I searched online and found out that I have to create dummies for each categorial variable. But, I have 16. I don't think it's efficient! I believe it will create many errors.

So, what to do? is there a way that SPSS can do that by itself in the background?

Or maybe a different regression approach? I found that there is something called General Linear Model, it separates the nominal variables from the continuous ones before doing the analysis.


r/AskStatistics • • 4d ago

Struggling with determining significance: How to analyze number of occurrences per group member per day per treatment?

7 Upvotes

Say I'm attempting to determine significance of temperature on the sprout timing of a species of grass. I have 2 groups of 30 pots held at either temp A or temp B. My results are in the form of the number of sprouts that emerged in each pot on each day of the experiment, as well as the temperature at which they were grown. What kind of analysis is best for determining whether there is a significant difference between the timing of the two temperature groups? I'm very grateful for any suggestions.


r/AskStatistics • • 4d ago

Seeking advice on treating seasonality

Post image
20 Upvotes

I am working with a dataset containing a bank's daily operational losses, classified into five event types, over the period from January 2004 to June 2015. The original dataset consists of approximately 5,000 daily observations, with each column representing a different event type.

Since daily observations are too granular for my analysis, I have aggregated the losses at a monthly frequency. The resulting dataset is structured as a matrix in which each row represents a month and each column corresponds to one of the five event types. Each entry records the total amount of operational losses incurred for a given event type in a specific month.

My objective is to implement a Loss Distribution Approach (LDA) to estimate the Value-at-Risk (VaR). This requires modelling the frequency and severity distributions of operational losses, as well as capturing the dependence structure between the frequencies of different event types. More specifically, I intend to compare the Poisson and Negative Binomial distributions to identify the most appropriate model for loss frequencies, while also selecting suitable parametric distributions for loss severities.

However, the dataset exhibits a systematic seasonal pattern: the number of recorded operational losses tends to increase towards the end of each quarter. I believe this pattern is artificially induced by the bank's reporting practices rather than reflecting genuine fluctuations in the underlying operational risk. This raises an important modelling issue, as the seasonal component may affect both the estimation of the marginal frequency distributions and the dependence structure between event types.

I would therefore like to understand how seasonality should be handled in this context. Specifically, should I adjust the observed frequency data directly (i.e. deseasonalise the time series), or should I account for seasonality within the estimation of the marginal distribution parameters, for example by allowing the expected frequency to vary over time according to a seasonal component?

NB. A structural break seems to occur after 2008 but I do not want to account for it at the moment. I just need some advice on adjusting for seasonality


r/AskStatistics • • 4d ago

Phenomenological Growth Models

1 Upvotes

I have a thesis that uses a Phenomenological Growth Models. It is okay for monthly data? What are your tips on using this Models?