Working with Paths

File paths are different on Windows (C:\Users\name) vs Unix (/home/name). Python provides tools to handle paths in a cross-platform way. The traditional os.path module uses string functions, while the modern pathlib module (Python 3.4+) treats paths as objects. Understanding both makes you prepared for any codebase!

The os.path Module

The os.path module has been Python's path-handling solution since the beginning. It provides functions to join, split, normalize, and query paths. The key function is os.path.join() which uses the correct separator for the operating system.

Click Run to execute your code

The pathlib Module (Modern)

The pathlib module, introduced in Python 3.4, represents paths as objects with methods and properties. This is now the recommended approach for new code. Paths can be joined with the / operator, making code more readable and Pythonic.

Click Run to execute your code

File and Directory Operations

Beyond just manipulating path strings, you'll often need to create directories, copy files, rename items, and delete things. The pathlib module handles most operations, but shutil is needed for copying files and recursively deleting directories.

Click Run to execute your code

Directory Traversal

Finding files in a directory tree is a common task. Use iterdir() for immediate contents, glob() for pattern matching, and os.walk() when you need full control over the traversal. The ** pattern enables recursive searching.

Click Run to execute your code

Common Mistakes

# Wrong - breaks on Windows!
path = "folder/subfolder/file.txt"
path = "folder" + "/" + "file.txt"

# Correct - use os.path.join or pathlib
import os
path = os.path.join("folder", "subfolder", "file.txt")

from pathlib import Path
path = Path("folder") / "subfolder" / "file.txt"

# Wrong - crashes if file doesn't exist!
from pathlib import Path
p = Path("maybe_exists.txt")
content = p.read_text()  # FileNotFoundError!

# Correct - check first
if p.exists():
    content = p.read_text()
else:
    content = ""

# Or use try/except
try:
    content = p.read_text()
except FileNotFoundError:
    content = ""

# Wrong - fails if parent doesn't exist!
from pathlib import Path
Path("new/nested/dir").mkdir()  # FileNotFoundError!

# Correct - create parents too
Path("new/nested/dir").mkdir(parents=True)

# And exist_ok to avoid error if exists
Path("new/nested/dir").mkdir(parents=True, exist_ok=True)

# Mixing strings and Paths can cause issues
from pathlib import Path

# Wrong - string concatenation
base = Path("/home/user")
full = str(base) + "/file.txt"  # String, not Path!

# Correct - use / operator
full = base / "file.txt"  # Still a Path object

# Or convert at the end if needed
path_str = str(base / "file.txt")

# Wrong - iterator exhausted after first use!
from pathlib import Path
files = Path(".").glob("*.py")
print(f"Count: {len(list(files))}")
for f in files:  # Empty! Iterator already consumed
    print(f)

# Correct - convert to list first
files = list(Path(".").glob("*.py"))
print(f"Count: {len(files)}")
for f in files:
    print(f)

Exercise: File Organizer

Click Run to execute your code

from pathlib import Path
import shutil

def organize_by_extension(directory):
    """Organize files into folders by their extension."""
    base = Path(directory)

    # Find all files (not directories)
    files = [f for f in base.iterdir() if f.is_file()]

    for file in files:
        # Get extension without dot, or 'no_extension'
        ext = file.suffix[1:] if file.suffix else "no_extension"

        # Create extension folder
        ext_folder = base / ext
        ext_folder.mkdir(exist_ok=True)

        # Move file to extension folder
        dest = ext_folder / file.name
        file.rename(dest)
        print(f"Moved: {file.name} -> {ext}/{file.name}")


# Test it
test_dir = Path("test_organize")
test_dir.mkdir(exist_ok=True)

# Create sample files
(test_dir / "script.py").touch()
(test_dir / "utils.py").touch()
(test_dir / "data.txt").touch()
(test_dir / "notes.txt").touch()
(test_dir / "image.png").touch()
(test_dir / "README").touch()

print("Before organizing:")
for f in test_dir.iterdir():
    print(f"  {f.name}")
print()

organize_by_extension(test_dir)
print()

print("After organizing:")
for item in sorted(test_dir.iterdir()):
    if item.is_dir():
        print(f"  {item.name}/")
        for f in item.iterdir():
            print(f"    {f.name}")

# Cleanup
shutil.rmtree(test_dir)

Summary

What's Next?

Now that you can navigate the filesystem, let's learn about CSV files - one of the most common data formats. Python's csv module makes it easy to read and write spreadsheet-like data, and you'll see how to handle headers, different delimiters, and common pitfalls!