r/dataanalysis • • Jun 12 '24

Announcing DataAnalysisCareers

66 Upvotes

Hello community!

Today we are announcing a new career-focused space to help better serve our community and encouraging you to join:

/r/DataAnalysisCareers

The new subreddit is a place to post, share, and ask about all data analysis career topics. While /r/DataAnalysis will remain to post about data analysis itself — the praxis — whether resources, challenges, humour, statistics, projects and so on.


Previous Approach

In February of 2023 this community's moderators introduced a rule limiting career-entry posts to a megathread stickied at the top of home page, as a result of community feedback. In our opinion, his has had a positive impact on the discussion and quality of the posts, and the sustained growth of subscribers in that timeframe leads us to believe many of you agree.

We’ve also listened to feedback from community members whose primary focus is career-entry and have observed that the megathread approach has left a need unmet for that segment of the community. Those megathreads have generally not received much attention beyond people posting questions, which might receive one or two responses at best. Long-running megathreads require constant participation, re-visiting the same thread over-and-over, which the design and nature of Reddit, especially on mobile, generally discourages.

Moreover, about 50% of the posts submitted to the subreddit are asking career-entry questions. This has required extensive manual sorting by moderators in order to prevent the focus of this community from being smothered by career entry questions. So while there is still a strong interest on Reddit for those interested in pursuing data analysis skills and careers, their needs are not adequately addressed and this community's mod resources are spread thin.


New Approach

So we’re going to change tactics! First, by creating a proper home for all career questions in /r/DataAnalysisCareers (no more megathread ghetto!) Second, within r/DataAnalysis, the rules will be updated to direct all career-centred posts and questions to the new subreddit. This applies not just to the "how do I get into data analysis" type questions, but also career-focused questions from those already in data analysis careers.

  • How do I become a data analysis?
  • What certifications should I take?
  • What is a good course, degree, or bootcamp?
  • How can someone with a degree in X transition into data analysis?
  • How can I improve my resume?
  • What can I do to prepare for an interview?
  • Should I accept job offer A or B?

We are still sorting out the exact boundaries — there will always be an edge case we did not anticipate! But there will still be some overlap in these twin communities.


We hope many of our more knowledgeable & experienced community members will subscribe and offer their advice and perhaps benefit from it themselves.

If anyone has any thoughts or suggestions, please drop a comment below!


r/dataanalysis • • 11h ago

Data Question How Do You Avoid Duplicate Feedback When One Survey Fits Multiple Categories?

1 Upvotes

I have a question I'm hoping the community can help with.

When working with customer feedback survey data, we have multiple questions covering different offerings. The responses go through Caplena logic for categorization but a single survey response can land in multiple categories, which causes the same customer feedback to appear multiple times.

How do you handle this to avoid duplication? Would appreciate any insights or best practices.


r/dataanalysis • • 1d ago

Project buddy?

3 Upvotes

I started my analytics journey back in 24 but took a break since. I want to get back and continue practicing my skills but unfortunately I don’t have as much time as I used to. Does anyone want to be a project buddy? We can work on occasional projects? Cleaning date, making dashboards from online datasets?


r/dataanalysis • • 1d ago

Headless Excel Data Model with Python

0 Upvotes

I’ve released Excel Data Model Lab, an open-source Python library for creating and editing embedded Excel Power Pivot data models without Excel installed.

You can populate models with data from Python or configure supported external data connections. Build tables, relationships and measures, then add model-backed PivotTables and charts. The data can live entirely inside the model; worksheet copies aren’t required.

The demo includes 24,000 synthetic sales across six related tables, plus slicers, a timeline and CUBE formulas. The library creates the workbook headlessly; Excel handles calculation, report rendering and refreshing configured connections.

This is an early release candidate, and I’d welcome feedback from people building automated Excel reports. Compatibility reports, feature requests and examples of workflows this could simplify would all be helpful.

GitHub and demo: https://github.com/sean-palmer-coding/excel-data-model-lab
PyPI: https://pypi.org/project/excel-data-model-lab/


r/dataanalysis • • 2d ago

opinion sobre como es el dia de un analista de datos

4 Upvotes

buenas tardes, me gustaria que alguien me compartiera su experiencia de la rutina de trabajo de un analista, es cierto que se pasa mucho tiempo sentado, que tanto de carga de trabajo es y si hay oportunidades de crecimiento, gracias


r/dataanalysis • • 1d ago

[self promotion] datasets for public bodies in Ireland

2 Upvotes

Hi,

I’ve pulled together a bunch of datasets indexed around public bodies in Ireland, which might be useful to someone.

https://publicinformation.ie

Caveat 1: I used AI to build pretty much all the software and pipelines that pull the data, transform it, and so on. I’m a former software engineer, and started out thinking I’d write most of it, but I’m rusty and it’s just way faster with AI tools

Caveat 2: The datasets contain errors. I’ve tried to publish the error information so at least you can see the errors I’m aware of. There may be unknown errors too.

The FOI requests are particularly challenging. The source is a mix of PDF (digital and scanned), Excel and HTML tables. The structures are many and varied, and are broken in so, so many different ways.

Caveat 3: I’m not a data engineer. Be gentle.

If you find it useful, I’d appreciate a star for visibility https://github.com/publicinformation-ie/publicinformation-data

If not, tell me why and what I should do better 🙏

D.


r/dataanalysis • • 3d ago

FAERS is a masterclass in why you model the data-generating process before the data

16 Upvotes

If you want a dataset that punishes naive counting, the FDA's adverse-event database (FAERS, public via OpenFDA) is perfect. Twenty-plus million reports, and almost every property a data scientist relies on is absent or adversarial:

No denominator. Reports are suspicions filed voluntarily. There is no exposed-population count, so no incidence rate can ever be computed — any "rate" derived from it is fabricated.

Duplicates by design. The same case can be submitted by the patient, a pharmacist, and the manufacturer, plus follow-up versions of each. Deduplication and restricting to primary-suspect reports is the first pipeline step, not an optional cleaning nicety.

The collection process reacts to publicity. For semaglutide, reports by year received run: 40 through 2017, 1,142 in 2018, 3,515 in 2020, 6,302 in 2022, 9,483 in 2023, 14,287 in 2024, 19,977 in 2025. That curve tracks adoption and media attention. Treating it as a risk curve is the classic error.

Coding artifacts dominate naive rankings. MedDRA Preferred Terms include administrative entries — "Off Label Use" alone accounts for 7,316 semaglutide reports. Rank raw terms and your top "adverse events" are paperwork.

Missingness is informative and huge. Outcome and age fields are blank in a large share of reports; blank means unknown, not none.

The standard tool that survives all this is disproportionality analysis — ROR/PRR against the full database, with the Evans criteria (PRR ≥ 2, chi-square ≥ 4, ≥ 3 cases) as a screening rule. In an October 2026 snapshot, semaglutide's impaired gastric emptying posts ROR 117.2 (95% CI 112.7–121.9), and 96.9 when restricted to 2023–2026 — a signal that persists after you control for the publicity era. That persistence check is the whole game: a statistic that survives interrogating the generating process.

What other public datasets do people here use to teach "the count is not the phenomenon"?


r/dataanalysis • • 3d ago

A practical learning order for beginners, with a realistic timeline

4 Upvotes

I get asked fairly often how to start in data analysis with no experience, so here is the order I would follow if I had to begin again, plus a timeline that is honest about how long this takes.

Start with spreadsheets, not Python. Excel or Google Sheets will still be part of the job even if you later use other tools. Learn how to clean a messy export, write formulas, build a PivotTable, and make a simple chart that answers one question. If you cannot turn a raw file into a clear summary, the rest of the stack will not help much. This is a few weeks of work if you practice on real files, not just tidy tutorial datasets.

Add a little statistics next, but keep it practical. You want medians as well as averages, a basic sense of distributions, and a habit of asking whether two things that move together are actually causing each other. This is not about becoming a statistician. It is about not presenting a clean number that is quietly wrong.

Then learn SQL. In a lot of companies, this is how data actually gets pulled. I would learn it in this order: SELECT and FROM, WHERE, ORDER BY, aggregates with GROUP BY, then INNER and LEFT JOINs. Practice until you can explain what a join keeps and what it drops. Also watch for joins that duplicate rows and inflate totals. That mistake is easy to miss.

After SQL, pick one visualization tool and stay with it long enough to get decent. Power BI, Tableau, or even well-built Excel dashboards are all fine. The skill is not the software brand. It is showing a finding so a non-technical person can use it.

Python can come after that. I would focus on pandas and basic plots first. Machine learning can wait. Plenty of junior work is Excel, SQL, and a clear explanation, not a model.

The part that matters for applications is a small portfolio. Three to five projects is enough if they are finished. Use public data, pick a question a real team might ask, write down your steps, and be honest about the limits of the data. A short write-up of one good project beats a list of unfinished notebooks.

On timing: if you can give this 8 to 10 hours a week, six to twelve months is a realistic window for junior or internship-level work. Less time per week stretches that out. A two-month crash plan usually produces shallow projects. The better test is not "how many tools have I opened," but "can I take a messy question and come back with a clear, careful answer?"


r/dataanalysis • • 6d ago

Why?

Post image
9 Upvotes

r/dataanalysis • • 6d ago

Project Feedback Cloudflare's analytics dashboard wasn't keeping up with my site metrics. So I built an atlas for my 30 day site traffic.

0 Upvotes

r/dataanalysis • • 7d ago

Project Feedback I built a free .pbix viewer that opens your file locally. Nothing is uploaded

Thumbnail
powerbireader.app
10 Upvotes

Select a .pbix file and it runs entirely in your browser. The file is never sent to a server, all information is kept locally.

Features:

- Lists tables, columns and relationships

- Export tables to CSV/XLSX

- Shows all DAX measures with their expressions

- No install and no account

Feedback and suggestions are very welcome!


r/dataanalysis • • 6d ago

Wrote down 150 forecasts with a % over 3 months. My 90% calls hit 71% of the time

0 Upvotes

started this after reading superforecasting. every week i wrote 10-15 small predictions with a %, stuff like the weather, if a package shows up on time, sports, btc closing higher, work deadlines.

results after 3 months:

-50-60% calls: hit about 57%, fine

-70-80% : hit 66%, a bit overconfident

-90%+: hit 71%, very overconfident lol

-worst topic by far was prices. my btc calls were basically a coin flip with extra confidence

anyone else track this? what actually helped you get better calibrated


r/dataanalysis • • 7d ago

Advice about interacting with Claude for complex projects?

22 Upvotes

I'm struggling at work, and I need advice. I'm an analyst, but my question is not super specific to analytics, so I understand if I need to move my post.

The main problem is that I've had multiple coworkers send me long, Claude-generated documents about our data models and tasks, and I am having a hard time understanding them.

I work at a decently large company, and I've been shuffled around on a few different projects. This means I have to learn all about the underlying data models, metrics definitions, etc. each time I move. I am a big "learn by doing" person. In my previous jobs, I'd be assigned a couple of ad hoc requests, and that would help me build my understanding of the data and how it's used.

At this job, someone (peer or, the main culprit , my own manager) will send me a zip folder with a mix of md, sql, py, all generated by Claude, and say "this should have what you need." I'm expected feed everything into Claude, validate the output, and then have a report or updated data model ready to go in less than a week. Most of the instructions I receive were written by a robot, for a robot. Standard, shared documentation is missing in a lot of places, and the context lives in someone's head and then gets put into a prompt for Claude.

I'm having a major comprehension problem paired with a speed problem. I'm expected to move quickly and defend all my numbers, but I feel I can only do one or the other. My boss insists I must be prompting Claude incorrectly if I am getting confused or slowed down.

Does anyone have advice about how I can use Claude (as it is required by my company) but not totally melt my brain? I feel so lost right now.


r/dataanalysis • • 7d ago

How do you deal with this

1 Upvotes

Hi,

I have been doing data analysis for quite some time now, and notice a common theme of issue I have had when working across departments in my company, as the dataset may vary the knowledge required to understand is always different, hence getting the time to sit down and study them, is near impossible.

In some cases, values in columns don't make sense, objectives aren't properly defined, or important information is scattered across questionnaires, documents, emails and conversations with the people who collected the data.

And of course, the people who have that knowledge aren't always available when you need clarification.

I want to understand how other people deal with this, particularly those working across multiple projects or departments in a company or organisation.

I have been trying to tackle this issue by using a plugin (currently still in the work, but getting good result so far), to assist me . With it, I am able to simultaneously connect the spreadsheet I'm analysing to a shared project space containing uploaded contextual documents or files that contains information and knowledge related to the spreadsheet, so I can find information without having to search through everything manually again. So when going through the dataset, I can click on a variable and it searches the documents and find information on it that are presented in those saved documents.

But nonetheless, I'm interested in how you approach these problems, especially those working in different industries or with larger datasets.

Would love to hear about your experiences.


r/dataanalysis • • 8d ago

Project Feedback Can anyone help me with project execution ? how do i approach it ? Created a Guide but didn't worked out well

0 Upvotes

Hii everyone,

I was a digital marketer executive in an agency, after i quit my job i started learning tech stack for data analysis i am finished with learning and currently on project i started my project last week its a cart abandonment analysis from GA4 dataset on big query whole plan is to analyze using creating a funnel than using python perform statistical tests ( hypothesis testing and ab testing ) and present my findings through power bi.

ideation part was done now i actually had to do project so i asked claude to create a guide for me to follow, a project guide and another solution guide to it.

But the guide's language was tuff it gave me ques and was done with i didn't knew what to do or how to do to it fast forward to today i have improvised and created 4th version of that guide with improved language better guidance but there is always something missing a vague question important information being left out for my sake i created an excel with imp fields out of 108 columns.

Today after writing a 50 line query to create a session table i was confused like why am i doing this i couldn't ans why i need this table it doesn't look like the funnel i thought it would be, mind you i have created funnels before in sheets for campaign analysis from top of the funnel metrics to the bottom of funnel from cpm cpc ad spend to order initiated order completed and all the steps in between so i asked chatgpt about the funnel part of my project ( which i thought i was working toward bcz of all the steps in between ) how is it related and it couldn't ans probably or give me reason which makes sense i wanted an industry level project and it told me that we will prove that shoppers are dropping and at what stage like wtf we already know shoppers are dropping and told me to analyze by device and demographics which still falls under EDA what realistic problem finding is that and what realistic solution can i provide ?

I am facing too much time reading that guide and going back and forth with GPT/claude to understand things and actual process because of the confusion caused by guide and even the solution fields don't match, can anyone help me with execution how do i execute and create portfolio projects i tried looking up DA projects of people on GitHub but didn't find anything useful i don't know how to even represent a project.

I need a framework on how to create a project i am not copying from anywhere just need guidance, looking for advice on how should i approach project creation even ready to pay ( although i don't have much money tbh but still )

I am seconding guessing that i should just create project with ai ideation would be mine and i can just understand the code and project ( practise SQL and pandas daily and DAX few times a week ) that way i will have coding syntax in mind and create projects more and faster which will get me interviews real learning is on the job anyways i have forecasting, data cleaning and time series projects in mind as well i am short on savings money as well


r/dataanalysis • • 8d ago

Data Question Refunds in monthly revenue reports: order month or refund month?

1 Upvotes

I build sales reports for e-commerce brands and this keeps coming up. A customer orders in October and gets refunded in November. Shopify puts the refund in November, and accounting usually wants it there too. But if you're judging how October's campaign or product did, it makes more sense to pull the refund back to October, otherwise October looks better than it was and November looks worse.

How do you handle it? One view, two views (by refund date and by order date), or something else?


r/dataanalysis • • 9d ago

Career Advice Question for Experienced Data analyst

8 Upvotes

Howdy people!!

I have been a data analyst for about half a year now and has experienced few issues when it comes to handling and processing data for reporting; some due to departments giving dataset that aren't clear, some due to report requirements or objectives not being definitive and some may be due to unavailability of higher ups who have key knowledge of the data, as of course they are busy people, and so the report you will write is highly dependent on the source data.

Aside this as I grow in my data analytics career what problem could one also face, or even better what problem or experience have you faced or is common in your own area of work or environment as a data analyst.


r/dataanalysis • • 9d ago

Please fill it (crying emoji 1000 times)

3 Upvotes

Would really appreciate a few seconds of your time to explore our dashboards and share your feedback through a short questionnaire. Your responses will help us understand how people interpret and trust AI-based fraud predictions.
Questionnaire: https://forms.gle/eCAHLwVgc3W795dk6

Your participation would mean a lot to our research. Thank you for your time and support!

Please fill it (crying emoji 1000 times)


r/dataanalysis • • 9d ago

Data Tools How did you learn Excel?

19 Upvotes

I am mainly self taught after finding an interest in it from a college project so I'm curious how others have gone about becoming efficient in excel and how long it took to become comfortable with it


r/dataanalysis • • 9d ago

which ai for data analytics learning phase

1 Upvotes

hey guys, i need an ai to help me throughout my data analyst course. it needs to help me with sql, excel, and data visualization, and also act as a mentor. would you recommend claude pro or chatgpt plus?


r/dataanalysis • • 9d ago

Looking for comprehensive Excel and Power BI courses (beginner to advanced)

21 Upvotes

Hi everyone!
I’m looking for recommendations for comprehensive Excel and Power BI courses that cover everything from beginner to advanced levels.
I already have an intermediate level of Excel, but I’d like to take a structured course starting from the fundamentals and progressing to advanced topics. My goal is to obtain a certificate that reflects a complete learning path, rather than taking several short courses covering isolated topics.
I’m open to both free and paid options. What matters most to me is course quality, practical knowledge, and recognition in the job market.
I’d appreciate recommendations regarding:
Which platforms and courses offer the best beginner-to-advanced learning paths?
Is it worth taking a complete course even if I already have some intermediate knowledge?
Are there recognized certificates or certifications that employers actually value?
Should I learn Excel first and then Power BI, or study both simultaneously?
Which courses include practical exercises and real-world projects?
For context, I have a background in Chemistry and would like to apply these tools to laboratory work, quality control, research, data analysis, and process monitoring.
I’d especially appreciate recommendations from people who have completed these courses or use Excel and Power BI professionally.
Thanks!


r/dataanalysis • • 9d ago

I'm building an interactive site to explain web analytics concepts visually. Would love your feedback!

3 Upvotes

Hi all,

I've started building a free website that explains web analytics concepts (like sessions, bounce rate vs. exits, engaged sessions, active users) through interactive visuals.

The goal is to make tricky measurement rules intuitive without having to dig through dry documentation.

You can check out what I have so far here: https://seeinganalytics.com

I'd love your honest feedback on:

  • Are the visuals clear and accurate?
  • Which confusing analytics concepts should I tackle next?

Thanks!


r/dataanalysis • • 9d ago

Is this the kind of project that gets you entry level jobs?

Thumbnail
github.com
10 Upvotes

r/dataanalysis • • 9d ago

Microsoft Teams 365 reliability

3 Upvotes

My office has 365 and uses Teams and Sharepoint as much as possible. I'm a new data analyst (no actual experience, I've been with them for 20 years in an unrelated role and a few months ago they decided to weaponize my ADHD by anointing me with their first data analyst title). Because we're already so integrated with Teams, I've been trying to build projects within it, but I've been plagued with occasional glitches.

The last time this happened, I was chasing my tail for hours trying to debug something that turned out to be a random issue with Teams hanging up. This time, I'm trying to daisy chain Power Apps, Power Automate, and Sharepoint lists to ghetto rig a free kinda-sorta-database. It's nothing important, we have a legit database for incident logging, I'm just building a tool for front-line personnel to help with assignment rotation and informal analysis of one specific incident type.

Once again, I was just chasing my tail thinking something was wrong with my half-built Power Automate flow that was randomly alternating between working and not working, until I noticed my Outlook and Copilot app were acting up too, and now both are completely down after rebooting everything. I see that Microsoft 365 has a global partial service interruption now and am wondering how much faith I should put into 365 actually working on a daily basis. Is this a common issue? Would it be better to do most things outside of 365 whenever possible? Or is the interconnectivity worth it for the occasional glitch?


r/dataanalysis • • 10d ago

Data Tools Built an open-source archive + API for 8 years of F1 data (telemetry, laps, weather, radio) with CSV/Parquet/SQLite export

Post image
3 Upvotes

Sharing a project that might be useful if anyone here is into sports/motorsport data or just wants a real-world dataset to practice on.

F1Archive is an archive of 8 seasons of Formula 1 session data, lap times, full telemetry (speed, throttle, brake, gear, RPM, DRS), tyres, weather, race control, team radio, stored in Postgres with a documented REST API and bulk export in CSV, JSONL, Parquet, or SQLite. There's a web viewer for exploring it visually, but it's genuinely usable as a raw dataset source for anyone who wants to do their own analysis without having to scrape and clean the data themselves.

One thing I tried to do properly: data completeness is documented, not hidden. If a session is missing telemetry or has partial data, there's a page explaining exactly what's missing and why, which matters a lot if you're doing anything you want to trust the results of.

Fully open source, happy to talk through the schema if anyone wants to use it for a project.

Have a look at f1archive.org