vl-directory-files limits

[SAPER59]

I'm using vl-directory-files to get and modiy all files inside a directory but has a limit aroun 988 files, the others are not included in the list obtained

Is it there a limit for the ammount of files, and in that case how to solve this?

Thanks

[hak_vz]

Haven't had a situation to work with so many files in a directory, and I'm not aware of the limit.

 All your files in a directory are of same type?

If not try to search for files by type or use DOS like match patterns, and then join the resulting lists.

Let say fires search for .dwg files, than .txt.

(vl-directory-files "c:\\myfiles\\" "*.dwg")

(vl-directory-files "c:\\myfiles\\" "*.txt")

If they are of the same type try to use search pattern mask

(vl-directory-files "c:\\myfiles\\" "A*.dwg")

[pbejse]

---

@SAPER59 wrote:

I'm using vl-directory-files to get and modiy all files inside a directory but has a limit aroun 988 files, 

---

This thing beats the function by 11

The maximum score is 999

[cadffm]

@SAPER59 

I don't know what your exact vl-directory-files statement is,

and i don't know about limits,

but the limit is not 998.

Quick test on my HD: Without a problem 1030 DWG in a directory

I used (length(setq DL (vl-directory-files "C:\\MyPath" "*.*" 1)))

Are you sure the problem is vl-directory-files?

[hak_vz]

When you create large list with 1000 + elements and try to list it in a console it will not  show, but list is created and it can be shown and used. For a test one can save it to the output file.

[ronjonp]

Over 12k here:

[cadffm]

---

@hak_vz wrote:

When you create large list with 1000 + elements and try to list it in a console it will not  show, but list is created and it can be shown and used. For a test one can save it to the output file.

---

I am missing the question you answered to, but:

That's not right, or i don't understand what you trying to say.

It is depending of your function & commands

(foreach ... (princ...)) works for example

[hak_vz · Accepted solution]

@SAPER59 

Try this code that uses Windows Scripting Shell.

(defun c:getFilesInDirectory nil 
    (getFilesInDirectory (getstring "\nEnter directory path string >"))
)

(defun getFilesInDirectory (path / wshShell allFiles stream filelist str_to_lst)
(defun str_to_lst (str del / len lst pos )
    (setq len (1+ (strlen del)))
    (while (setq pos (vl-string-search del str))
        (setq lst (cons (substr str 1 pos) lst)
              str (substr str (+ pos len))
        )
    )
    (reverse (cons str lst))
)
(setq wshShell (vlax-create-object "WScript.Shell"))
(setq allFiles (vlax-invoke-method wshShell 'Exec (strcat"cmd /c dir " path " /a:-d /b")))
(setq stream (vlax-get-property allFiles 'StdOut))
(setq filelist (vlax-invoke-method stream 'ReadAll))
(str_to_lst filelist "\r\n")
)

Usage :

(getFilesInDirectory "H:\\Lisp\\*.lsp")

[hak_vz]

@cadffm  When you create really large list and if you use ! in system console it won't show i.e it wont be listed.

[ronjonp]

There is also this if you want to process subdirectories as well.

[pbejse]

---

@SAPER59 wrote:

I'm using vl-directory-files to get and modiy all files inside a directory but has a limit aroun 988 files, the others are not included in the list obtained

---

The question everyone is asking is what limit?  number of items on a list? 

Items you can "see" on vlide console?

Most likely there is a bug in your code.

I remember one time:

A code encountered a temporary file and stops, the file inm question's description is just "File" and 0KB not any defined file nor a folder.  

I included this check.

(vl-filename-extension thefile)

Eveything went smoothly after that.

[cadffm]

---

@hak_vz wrote:

@cadffm  When you create really large list and if you use ! in system console it won't show i.e it wont be listed.

---

Perhaps, but not  a limit of 998 or...

>"Try this code that uses Windows Scripting Shell."

Sorry. No time and no desire, Nothing to do with the topic & question, so it's offtopic

As i wrote: It is depending of your function & commands

thx

[hak_vz]

@cadffm 

---

@cadffm wrote:

---

@hak_vz wrote:

@cadffm  When you create really large list and if you use ! in system console it won't show i.e it wont be listed.

---

Perhaps, but not  a limit of 998 or...

>"Try this code that uses Windows Scripting Shell."

Sorry. No time and no desire, Nothing to do with the topic & question, so it's off topic

---

Sorry @cadffm  but I don't agree that it is off topic.

Let @SAPER59  test the code and see if list length received with both method is equal. There have been posts in the pasts that complain about vla-directory-files method and limits. If he uses some older version of Acad or derivative anything is possible.

[cadffm]

@hak_vz 

Yes, okay
Instead of first determining if there is a problem, you can just take another route instead.

(I mistakenly assumed earlier that you posted the code for me, which is not the case, that was the reason why I had even replied to it)

I favor checking first
whether there is a problem
what the problem is
and subsequently
I'm trying to solve the problem if it doesn't work
then I go another way:

Advantage: You expand your knowledge and thus know your way around better.

And in the case of a forum question, I also try to answer the question asked first.

The alternate code wasn't totally off-topic, but doesn't answer the question.

Kudo4u
Sebastian

[Sea-Haven]

Using old fashioned DOS you can get a list of files into say a text file. This can be ran as a Shell function in lisp.

DIR c:\topleveldirectory\*.dwg /b /s >dwgs.txt

[pbejse]

That did not tell us anything on why it max out on 988. 🤔 

We never did know why it behaved that way on OP's end. Not a proper way to end a discussion IMO, Oh well.

[ronjonp]

---

@pbejse wrote:

That did not tell us anything on why it max out on 988. 🤔 

We never did know why it behaved that way on OP's end. Not a proper way to end a discussion IMO, Oh well.

---

@pbejse  Agreed. 🍻

[john.uhden]

I disagree.  The OP obviously wants to get a list of all the files in a directory.  If he has experienced mistrust with vl-directory files, then he might get more comfortable with an alternate method.  I remember a time when (vla-whatever object) did not work but (vlax-invoke object 'whatever) or (vlax-invoke-method object 'whatever) would, or vice versa.  I really didn't care why.  I just wanted something that worked.  But that's only an opinion.

[ronjonp]

---

@john.uhden wrote:

I disagree.  The OP obviously wants to get a list of all the files in a directory.  If he has experienced mistrust with vl-directory files, then he might get more comfortable with an alternate method.  I remember a time when (vla-whatever object) did not work but (vlax-invoke object 'whatever) or (vlax-invoke-method object 'whatever) would, or vice versa.  I really didn't care why.  I just wanted something that worked.  But that's only an opinion.

---

I'd still like a data set to see where this 'limit' is reached. I have never had a problem with it in the past 20 years.