We're a little crazy, about science!

Posts tagged “data science

Intro to MATLAB – Part 2

I’m teaching an intro to MATLAB class and if it’s one thing I hate it’s hording knowledge so I’m sharing it here for all of you to enjoy! If you missed the first part, fear not you can find it here. I’ve also created a special category (the Intro to MATLAB category) where you can find these posts and a whole lot of other things I’ve taught, like my 10 week solid modeling for beginners classes and my incredibly detailed and surprisingly popular, know your spinal cord series (my personal favorite). Okay enough plugging my classes, let’s talk MATLAB.

(more…)

A data detective

You did a cool experiment, you have some interesting data, and you found something unexpected! Great, but what does it mean? Sometimes the answer isn’t as straightforward as you may hope. That’s the problem for the day, I found something in my data that makes no sense and the worst part is I have no idea what it means. It’s definitely something, so now I need to go through the steps of making sense of it. That’s the problem with doing something new, you have no frame of reference for the result.

(more…)

Flexible coding for data visualization

My main-PI has an odd habit of wanting us to edit things as we’re presenting them. I’ve watched this happen and had to do it myself. Suddenly you find yourself editing a paper/grant/etc. and forgetting how to spell your name because you’re so flustered. It isn’t just papers though, it’s our visualizations that we make. He will ask us to go in and change things as they are being shown. This has happened to me several times already and more often than not I’m ready for it. So today I figured I would go over some of the things I do to make sure that I don’t spend the entire time sweating over edits to my code.

(more…)

Fun with Rstudio

Okay, not really. Having to use R is a pain. I’m not a fan and the structure they use is very confusing to me as someone who uses MATLAB on a regular basis. I understand matrices, I regularly make and successfully work with higher dimensional matrices ( > 3, which hurts your brain to think about a 20+ dimensional matrix, but hey whatever gets the job done). R on the other hand feels foreign and the commands feel clunky.

(more…)

The long data processing road

Okay I’m taking another break from the “in statistics” posts, at least for today since the next topic is going to be a long multi-day post worth of stuff and I need an easier post for today. I have way too much stuff going on at the moment to organize a long post! In any case, I figure I could give an update to the data I’ve been working with and how that whole mess is going. It’s mind numbing and exhausting work, but not in the way you would think.

(more…)

More data surprises!

Data’s the gift that keeps on giving. Okay not really, but I wish it were!

Well I’ve finished with the new dataset I collected for my PhD project, it was a fast analysis so there is still a lot more I can do with it, but I’ve finished at least the initial processing and plotting. Overall it’s good news so now I’m just waiting to hear back from my Co-PI to confirm my findings or more than likely temper my excitement.

(more…)

More data, more problems

Maybe the title should be no data, no cry. Anyway here we are another day and there’s a lot going on, but I finally did it! I got some results from my new dataset that I hadn’t had a chance to process yet. And would you believe (despite the title) that I found something!? Yep, which is great news… except there’s more I need to do! My Co-PI who likes to temper my excitement when I come to him with results has reminded me that I should wait to celebrate until the rest of the data are analyzed.

(more…)

An early present

Since my deadline has come and gone I can look around for a moment, but more importantly I don’t feel the pressure to hyperfocus on a single project. So today instead of working on that dataset I’m switching to a dataset I need to get done before my PhD proposal defense. It’s data that will (assuming I find something) further help make my case for studying my new “super secret” technique for the next 2-3 years depending on how long everything takes.

(more…)

The coding hole

Help, I’ve fallen into a coding hole and I can’t get out! Okay, to be fair I actually DID get out, but at the time it felt like there was no hope and I would be trapped banging my head against a wall trying to figure out what I was doing. Today I figure we can discuss how I code and what my idea of a coding hole is, it will be a fun break for me.

(more…)

The art of coding

Well I did it. I got all the code written for the next two (of three) steps for processing my data. I can’t do the third until the second step is done for at least one dataset, but I’m almost there and the last bit of code is to visualize the data, which is substantially easier. So let’s talk about what I did and why I won’t have to do it again now.

(more…)

Data results!

light bulb in the sunset

About a week ago I collected some data randomly. Well let me start over, not randomly my Co-PI decided it would be a good experiment to collect the data using my “super secret” technique to verify that it worked. We had six different conditions and I’ve only processed two of the conditions, so there’s still some work to be done to determine if this is real or not, but I have my initial results and my Co-PI has seen them.

(more…)

More data!

Old wooden treasure chest with strong glow from inside.
Old wooden treasure chest with strong glow from inside.

It was a surprise to me, but I somehow ended up with a new dataset from a single subject. One that, after processing, could be the key to convincing my Co-PI once and for all that we have something real… or it could just be one giant mess, but if we don’t look we may never know.

(more…)

Dataset mining

We use heavy equipment to mine our data around these parts…

I did an experiment! That’s old(ish) news, but now I have some data to play with… lots of data. So now I get to do something somewhat enjoyable and that’s try to get cool and interesting stuff to fall out of it. All you have to do is shake it really hard and hope for the best.

(more…)

So much data

This has basically been my progression in this project.

Well I’ve processed (poorly) about half of my data. Now, when I say poorly I just mean the visuals for it are garbage and I need to tweek the sizes and things to make it look nicer, but the idea is that I’m more interested in finding something than I am in making it look pretty. I’ve processed two of four of my subjects and well I’m excited!

(more…)

The after

I’m trying to remain calm. I am an objective observer in the world of science and whatever the result, I will NOT let it cloud my emotions. I am neutral and I will remain that way… oh who am I kidding, I DID IT! Two years of planning and convincing people this would work. Then last night I had my first result, and it was a relief. It was a small step, but one I was afraid the data wouldn’t let me make.

(more…)

Day 99: Data request, a update

letters vs email

Sometimes emails can still be exciting!

I’ve got news! In my last post on the subject I said that I wasn’t expecting a response from the lab I was requesting data from until Monday, if at all. Well would you believe I got a response! It wasn’t a “here’s the data response,” but it is progress. Let me explain why.

(more…)


Day 97: Neural network models

Neural net

Today should be an interesting day for me. I plan to do a deep dive into the world of neural networks to better understand how they work and the best type to apply to my data. There are a few, quite a few in fact that I could use and really it depends on how I want to frame my problem, so let’s look at what I’ve got planned.

(more…)