NC_FLLST.DAT?

Started Oct 6, 2018 | Discussions
SrMi
SrMi Senior Member • Posts: 2,285
NC_FLLST.DAT?

I am surprised nobody mentioned NC_FLLST.DAT yet. It is generated every time in the image folder. What is that file about?

Lance B
Lance B Forum Pro • Posts: 33,410
Re: NC_FLLST.DAT?

SrMi wrote:

I am surprised nobody mentioned NC_FLLST.DAT yet. It is generated every time in the image folder. What is that file about?

I would like to know as well.

 Lance B's gear list:Lance B's gear list
Nikon D850 Nikon Z7 Nikon D500 Nikon Z7 II Nikon AF-S Nikkor 80-400mm f/4.5-5.6G ED VR +21 more
Russell Proulx Contributing Member • Posts: 943
Re: NC_FLLST.DAT?

That file (and others) do not appear when connecting the camera directly via a USB cable and transferring files to the computer.

It only appears when using my Sony external reader (and probably others).

When using the reader to access the XQD card with 33 NEF's
I see 2 folders + one hidden file in the root of the XQD card:

Folder1: DCIM containing 100NCZ_7 containing NEFs + NC_FLLST.DAT file (80k)

Folder2: NIKON containing Z_7 (both empty)

'Hidden' file: NIKON001.DSC file (64MB)

Perhaps these are files related to the partition table used on XQD cards and are only revealed when viewing the card outside of the camera? If so, I'm surprised they're not being better hidden as no cards I've used previously have displayed anything other than the image folder and files when accessed with a reader. No big deal if it's normal and just something new to get used to.

 Russell Proulx's gear list:Russell Proulx's gear list
Nikon Z7 Nikon D3S Nikon D800E Nikon 1 V1
Horshack Veteran Member • Posts: 8,680
Re: NC_FLLST.DAT?

Can you make a sample .DAT file available to download so that I and others can have a look at it? Thanks!

Russell Proulx Contributing Member • Posts: 943
Re: NC_FLLST.DAT?

Horshack wrote:

Can you make a sample .DAT file available to download

I'd rather not as I'm not 100% sure what the file contains. Opening it with Notepad++ reveals whole bunch of NUL's . There's a short header at the top with a few garbage letters. There's nothing in plain text that might reveal its purpose.

I really do suspect it's Nikon specific partition/formatting information that the camera ignores when transferring directly while an external reader does not.

I've Googled the XQD card and its file structure for any relevant tech details and found nothing. The card itself is formatted ExFAT and the checking its partition info claims it to be MBR.

I'll let someone who's more tech savvy and an Z7 + card reader to figure out what it is.

It's time for me to cook a turkey

 Russell Proulx's gear list:Russell Proulx's gear list
Nikon Z7 Nikon D3S Nikon D800E Nikon 1 V1
donsullivan Regular Member • Posts: 179
Re: NC_FLLST.DAT?

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file always seems to be 82KB in size no matter how many shots I've taken on the card that day.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

 donsullivan's gear list:donsullivan's gear list
Nikon Z7 Nikon Z 24-70mm F2.8 Nikon Z 35mm F1.8 Nikon Z 50mm F1.8 Nikon Z 14-30mm F4 +2 more
Horshack Veteran Member • Posts: 8,680
Re: NC_FLLST.DAT?

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

donsullivan Regular Member • Posts: 179
Re: NC_FLLST.DAT?

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

 donsullivan's gear list:donsullivan's gear list
Nikon Z7 Nikon Z 24-70mm F2.8 Nikon Z 35mm F1.8 Nikon Z 50mm F1.8 Nikon Z 14-30mm F4 +2 more
SrMi
OP SrMi Senior Member • Posts: 2,285
Re: NC_FLLST.DAT?

donsullivan wrote:

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

Or Nikon makes sure the file is properly hidden and does not bother us at import into LR.

donsullivan Regular Member • Posts: 179
Re: NC_FLLST.DAT?

SrMi wrote:

donsullivan wrote:

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

Or Nikon makes sure the file is properly hidden and does not bother us at import into LR.

The file is totally visible in the MacOS Finder without any special action. And a simple right-click allows you to open the file with a text editor. I never directly import from cards. I copy everything to the folder via the MacOS finder first and then Add to LR and leave the files in place. When I select all images in a folder and copy, this file is coming across each time. At least on a Mac, it is totally visible.

I just opened a support question with Nikon support to see if I can get an answer since I've never seen this

 donsullivan's gear list:donsullivan's gear list
Nikon Z7 Nikon Z 24-70mm F2.8 Nikon Z 35mm F1.8 Nikon Z 50mm F1.8 Nikon Z 14-30mm F4 +2 more
Horshack Veteran Member • Posts: 8,680
Re: NC_FLLST.DAT?

donsullivan wrote:

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

Human readable is different from human decodable. Reverse-engineering the file format and contents will likely be relatively easy.

SrMi
OP SrMi Senior Member • Posts: 2,285
Re: NC_FLLST.DAT?

donsullivan wrote:

SrMi wrote:

donsullivan wrote:

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

Or Nikon makes sure the file is properly hidden and does not bother us at import into LR.

The file is totally visible in the MacOS Finder without any special action. And a simple right-click allows you to open the file with a text editor. I never directly import from cards. I copy everything to the folder via the MacOS finder first and then Add to LR and leave the files in place. When I select all images in a folder and copy, this file is coming across each time. At least on a Mac, it is totally visible.

I just opened a support question with Nikon support to see if I can get an answer since I've never seen this

What I meant is that Nikon made that file visible by mistake. If they would name it '.NC_FLLST.DAT' it would still be there (for whatever reason), but it would not be visible in the Finder and would not pop-up import errors in LR.

michaeladawson Forum Pro • Posts: 15,773
Re: NC_FLLST.DAT?

Horshack wrote:

donsullivan wrote:

Horshack wrote:

donsullivan wrote:

I was curious what this file was as well so I opened it up and whatever is in it appears to be encrypted in some fashion because it's seemingly random garbage.

The file on my latest shoot was only 82KB in size. I haven't yet noticed if the file changes in size based on the number of shots stored in the directory on the card.

A segment of the contents looks like:

Ä¿C ćC ÄD Ä D Ä@D Ä`D ÄÄ

It’s likely a binary encoded file, which is why you don’t see much human-readable text. That doesn’t necessarily mean the data is also encrypted.

The bottom line is that it's not human readable. This is definitely something that Nikon is going to have to explain.

Human readable is different from human decodable. Reverse-engineering the file format and contents will likely be relatively easy.

The Fuji X-H1 introduced something similar.  I don’t know what the file is but when I download X-H1 files via a reader I get this extra .dat file.  Very annoying.

-- hide signature --

Mike Dawson

 michaeladawson's gear list:michaeladawson's gear list
Nikon D5 Fujifilm X-T2 Fujifilm X-H1 Nikon D7200 Nikon Z7 +39 more
DeSassmann Forum Member • Posts: 86
Re: NC_FLLST.DAT?
1

Horshack wrote:

Can you make a sample .DAT file available to download so that I and others can have a look at it? Thanks!

I have uploaded a sample file here:

https://www.dennis-sassmannshausen.de/samples/NC_FLLST.DAT

-- hide signature --

Dennis

 DeSassmann's gear list:DeSassmann's gear list
Nikon D4 Nikon D800 Nikon D2X Nikon D3X Nikon D700 +26 more
Horshack Veteran Member • Posts: 8,680
Re: NC_FLLST.DAT?

DeSassmann wrote:

Horshack wrote:

Can you make a sample .DAT file available to download so that I and others can have a look at it? Thanks!

I have uploaded a sample file here:

https://www.dennis-sassmannshausen.de/samples/NC_FLLST.DAT

Thanks. It looks like a simple index that's referencing other files. Can you tell me how many image files are in the directory this .DAT was pulled from?

Here's the data. The first 16 bytes looks like a header, which has both the per-entry size (0x10 or 16 bytes) and the total number of current entries (0x59).

00000000: 42 04 00 00 00 01 00 00 10 00 59 00 00 00 00 00
00000010: 81 d7 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000020: a1 d7 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000030: c1 d7 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000040: e1 d7 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000050: 01 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000060: 21 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000070: 41 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000080: 61 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000090: 81 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000a0: a1 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000b0: c1 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000c0: e1 d8 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000d0: 01 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000e0: 21 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000000f0: 41 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000100: 61 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000110: 81 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000120: a1 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000130: c1 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000140: e1 d9 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000150: 01 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000160: 21 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000170: 41 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000180: 61 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000190: 81 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001a0: a1 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001b0: c1 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001c0: e1 da 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001d0: 01 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001e0: 21 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000001f0: 41 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000200: 61 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000210: 81 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000220: a1 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000230: c1 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000240: e1 db 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000250: 01 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000260: 21 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000270: 41 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000280: 61 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000290: 81 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002a0: a1 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002b0: c1 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002c0: e1 dc 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002d0: 01 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002e0: 21 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000002f0: 41 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000300: 61 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000310: 81 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000320: a1 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000330: c1 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000340: e1 dd 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000350: 01 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000360: 21 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000370: 41 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000380: 61 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000390: 81 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003a0: a1 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003b0: c1 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003c0: e1 de 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003d0: 01 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003e0: 21 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000003f0: 41 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000400: 61 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000410: 81 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000420: a1 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000430: c1 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000440: e1 df 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000450: 01 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000460: 21 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000470: 41 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000480: 61 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000490: 81 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004a0: a1 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004b0: c1 e0 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004c0: 01 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004d0: 21 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004e0: 41 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000004f0: 61 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000500: 81 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000510: a1 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000520: c1 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000530: e1 e1 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000540: 01 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000550: 21 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000560: 41 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000570: 61 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000580: 81 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
00000590: a1 e2 60 03 80 00 00 00 00 00 00 00 00 00 00 00
000005a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

<repeats all zeros until EOF @ 0x14000>

DeSassmann Forum Member • Posts: 86
Re: NC_FLLST.DAT?
1

I can't remeber from which folder the file was pulled, but in all folders the DAT files have the same size.

This file comes from a older with 269 NEF files:

https://www.dennis-sassmannshausen.de/samples/269_NC_FLLST.DAT

-- hide signature --

Dennis

 DeSassmann's gear list:DeSassmann's gear list
Nikon D4 Nikon D800 Nikon D2X Nikon D3X Nikon D700 +26 more
Horshack Veteran Member • Posts: 8,680
Re: NC_FLLST.DAT?

DeSassmann wrote:

I can't remeber from which folder the file was pulled, but in all folders the DAT files have the same size.

This file comes from a older with 269 NEF files:

https://www.dennis-sassmannshausen.de/samples/269_NC_FLLST.DAT

Thanks. That .DAT file has 269 entries, so it's definitely some type of index that referencing each file in the directory. Each index entry is 16 bytes. The first 32-bit word is the reference. The byte after has a value of 0x80 - might be a file type (image, video, etc...). The rest of the entry is zeros.

DDMichel New Member • Posts: 3
Re: NC_FLLST.DAT?

Bottom line ....can the file be deleted without ramifications to the files ingested?   In my work flow with video,  I first COPY all files including the DAT file to my External drive. Then proceed to edit video footage.  Can I remove/delete that "dat" file from the copied list or just not copy it at all from the DCIM folder on the card.

Thanks,

Doug

donsullivan Regular Member • Posts: 179
Re: NC_FLLST.DAT?

since I always reformat in camera, the file just gets recreated. It’s so small I stopped worrying about it and it has no impact I can find on anything.

 donsullivan's gear list:donsullivan's gear list
Nikon Z7 Nikon Z 24-70mm F2.8 Nikon Z 35mm F1.8 Nikon Z 50mm F1.8 Nikon Z 14-30mm F4 +2 more
SrMi
OP SrMi Senior Member • Posts: 2,285
Re: NC_FLLST.DAT?

It is annoying that LR always reports an error because it cannot import NC_FLLST.DAT.

Keyboard shortcuts:
FForum MMy threads