How to Document and Organize Datasets in Obsidian


Dear Scholar,

I am currently conducting very data-intensive research that involves records from thousands of forest plots and measurements of millions of individual trees conducted over 50 years in New Zealand. A lot of data to analyze and find out how forests are changing. This massive data collection is aggregated from many sources, then cleaned, arranged, combined, filtered, recombined, processed, transformed, recleaned, and rearranged again. A very messy process that far surpasses the capacities of my brain.

To overcome this limitation, I started using Obsidian's Canvas feature to document and organise this process. The result is one of the most useful canvases in my research! If your research uses some data in some way, check out this week's article:

While this example primarily deals with CSV files and scripts that transform them, you can be creative and apply the same method to other domains. For instance, you could organize your systematic literature review with the same methods, but instead of forest data, you have papers! The key here is that you can document how datasets relate to one another and where you store them simultaneously.

Join the Upcoming Webinar

The Academic Knowledge Management Webinar 2.0 is coming up in a week, on May 3rd. Today's article is in line with what you will learn in this webinar: How to organize your research. Before the webinar, I always ask some participants to share their desires with me and adjust the webinar accordingly. Here is what the current survey is saying:

In this webinar, therefore, I will present to you how I organize large and complex projects with Obsidian. Here is a preview of my current strategy:

It has multiple connected elements (the first four shown in the screenshot):

  1. Open Directions: Notes describing what I need to do next, automatically colour coded by progress.
  2. Results: Notes describing key findings to use in a paper later.
  3. Follow-Ups: - Additional questions to ask and refine results
  4. Multiple canvases to capture various aspects of the project.
  5. Subtasks to break down big directional tasks.
  6. Progress: Notes capturing day-to-day progress.
  7. Reading Canvas: Organizes papers (see this blog post)
  8. ...and a few more bells and whistles.

This system gives me clarity and guidance every day when I show up at work and sit down in front of my computer and the gigabytes of forest data waiting to reveal their secrets.

Ready to transform how you organise research and boost your productivity and sanity? This webinar will include all the templates you need to set up the system yourself.

Free webinar ticket with course bundle

Those who decide to go all-in and get the Essential Course Bundle will, receive a free webinar ticket. This bundle includes the three most popular and important courses on note-taking, lit reviews and academic writing.

Wishing you a wonderful weekend,

Ilya Shabanov, The Effortless Academic

Don't want to receive emails like this: Unsubscribe from newsletter only .
Want to unsubscribe from all future emails?
Unsubscribe from everything.
Your
Preferences.

The Effortless Academic

Literature Review Tools, Note-Taking Strategies and AI tutorials for the modern academic. Publish more with less effort and supercharge your career.

Read more from The Effortless Academic

Top 20 Resources for Effortless Academics Dear Scholar, Over the past few years, I have published numerous articles on various tools, techniques, and innovative applications of AI in academia. This week I am sending you the 17 most popular and essential tutorials: Digital Note-Taking: Foundations of my digital note-taking system Adding AI to your digital note collection in Obsidian The best way to read and annotate PDFs in Obsidian Making "Colorful" Links for more structure in Obsidian →...

Tool Review: Yomu.ai for Academic Writing Dear Scholar, I am currently refining my latest paper and experimenting with various tools to enhance my academic writing. Today, I want to present a deep dive into Yomu.ai, which might be the most collaborative academic writing tool. In my opinion, Yomu is more targeted at younger career researchers or academics who are pivoting to a new domain or doing cross-disciplinary research. A recent Nature study I was reading proposes that there is a "pivot...

Sponsor: Yomu.ai Yomu AI is a writing assistant for essays and research papers. It enables real-time collaboration and offers features like citation management (via Sourcely), text editing, feedback, and plagiarism checking—all in one place. Learn more about Yomu.ai Get 20% off monthly: EFFORTLESS20Get 40% off yearly: EFFORTLESS40 Tutorial: Following Journals, Authors, and Domains Dear Scholar, Most of you have developed a way of finding relevant literature for your work using various tools....