PhotoFixer

Google Takeout Duplicates and Album Folders Explained

By Josep Mampel Marques, updated

Google Takeout shows the same photo several times mainly because of albums: the export has year folders such as Photos from 2022 plus one folder per album, and a photo that is in an album can appear in both. Other "duplicates" are not duplicates at all: (1) marks a different file with the same name, and -edited is the version you edited in Google Photos. The safe approach is to keep one copy per photo without deleting album-only photos, which PhotoFixer does when you choose the "By year and month" layout.

How a Google Photos Takeout is organized

Everything sits under Takeout/Google Photos/. As Ente's guide describes it, there are folders matching your albums, and photos that are not in an album go to year folders like Photos from 2022. When the library is split across several zip parts, the same album can be spread over more than one part.

GooglePhotosTakeoutHelper's documentation adds the detail that matters for duplicates: some photos exist only in album folders and not in any year folder. A photo in several albums ends up with a copy in each of them.

The five kinds of "duplicate"

What you seeWhat it isWhat to do
Same file in a year folder and an album folderAn album copyKeep one
IMG_0001(1).jpg next to IMG_0001.jpgUsually a different photo with the same nameKeep both unless the pictures are identical
IMG_0001-edited.jpgYour edit in Google PhotosKeep the version you prefer, or both
IMG_0001.HEIC and IMG_0001.MP4The photo and video parts of a Live PhotoKeep both
Whole library twiceTwo exports or two transfers importedImport only one export

(1), (2) in file names

Takeout adds a number in brackets when two files in the same folder would have the same name. That is common when photos come from different cameras or phones that number images the same way. The .json for IMG_0001(1).jpg is named IMG_0001.jpg(1).json, with the number in an unexpected place, which breaks simple matching scripts. More in Google Takeout JSON files explained.

-edited copies

If you edited a photo in Google Photos, Takeout exports the original and an edited copy named with -edited (the suffix can be shortened on long names). The edited copy has no .json of its own and uses the original's. GooglePhotosTakeoutHelper has an option to skip these extra images if you only want originals.

Two exports or two transfers

Google warns that transferring the same library again may create duplicates. Apple says a new transfer to iCloud after a storage error does not add duplicate files. Either way, importing a Takeout export on top of a direct transfer to the same app will duplicate everything; choose one route, as explained in Google Photos to iCloud.

Keep one copy of each photo

  1. Do not delete album folders by hand. Some photos only exist there.
  2. Open PhotoFixer and choose all the zip parts at once, so that every album and year folder is seen together. See Takeout multiple zip files.
  3. Choose By year and month. Every photo goes to a folder for the month it was taken, and an album copy that is byte-for-byte identical to a photo already in that folder is kept once. A different photo with the same name is saved as name (2).jpg, never dropped. Album-only photos are kept.
  4. Press Fix my photos. The summary shows how many album copies were skipped.
  5. If you would rather keep your albums as folders, choose Keep Takeout albums instead. Then each album folder keeps its copy, so the same photo can appear in several folders, just as in the export.

PhotoFixer treats two files as the same photo only when their size and CRC-32 checksum (stored in the zip) match, so edited copies and different photos are all kept. For wider duplicate detection across folders, GooglePhotosTakeoutHelper removes identical files using content hashing and can move them to a _Duplicates folder instead of deleting them.

Before you clean up

FAQ

Are files with (1) in the name duplicates?

Not necessarily. Takeout adds a number in brackets when two different files in the same folder have the same name, for example two IMG_0001.jpg from two cameras. Compare the pictures before deleting anything.

Why do I have IMG_1234.jpg and IMG_1234-edited.jpg?

The second one is the version you edited in Google Photos. Takeout exports both the original and the edited copy, and the edited copy shares the original's .json file.

Is it safe to delete the album folders?

Not blindly. GooglePhotosTakeoutHelper's documentation notes that some photos exist only in albums and not in the year folders, so deleting album folders can lose photos.

Sources