linuxのコマンドラインでargument list too longエラーが出た時の対処方法

1

ls dir1

1
2

getconf ARG_MAX
2097152

1

ls dir*

1

ls dir1 dir2 dir3 ...

1

find . -maxdepth 1 -type d -name 'dir*' | xargs ls

1

ls dir1 dir2 dir3 ...

1
2

ls dir1 dir2 dir3 ... dir1000 dir1001 dir1002
ls dir1002 dir1003 dir1004 ... dir2001 dir2002 dir2003

 1
 2
 3
 4
 5
 6
 7
 8
 9
10

xargs --show-limits
Your environment variables take up 6320 bytes
POSIX upper limit on argument length (this system): 2088784
POSIX smallest allowable upper limit on argument length (all systems): 4096
Maximum length of command we could actually use: 2082464
Size of command buffer we are actually using: 131072
Maximum parallelism (--max-procs must be no greater): 2147483647

Execution of xargs will continue now, and it will try to read its input and run commands; if this is not what you wanted to happen, please type the end-of-file keystroke.
Warning: echo will be run at least once.  If you do not want that to happen, then press the interrupt keystroke.

1
2
3
4

xargs -s 2000000 --show-limits
...省略
Size of command buffer we are actually using: 2000000
...省略

1
2
3
4

xargs -s 3000000 --show-limits
...省略
Size of command buffer we are actually using: 2088784
...省略

1
2
3
4

/# mkdir test
/# cd test
/test# mkdir dir{0001..1000}
/test# find . -maxdepth 1 -type d -name 'dir*' | xargs -I {} touch {}/file{001..100}.txt

1
2

/test# ls **/*.txt
bash: /usr/bin/ls: Argument list too long

1
2
3

/test# find . -type f -name '*.txt' | xargs ls -l > filelist.txt
/test# wc -l filelist.txt
100001 filelist.txt

1
2

/test# find . -type f -name '*.txt' | xargs -p ls -l
ls -l ./dir0586/file022.txt ...省略... ./dir0533/file071.txt ?...

1
2

/test# rm **/file{000..080}.txt
bash: /usr/bin/rm: Argument list too long

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26

/test# find . -maxdepth 1 -type d -name 'dir*' | xargs -I {} rm {}/file{001..080}.txt
/test# find . -type f -name '*.txt' | xargs ls -l > filelist.txt
/test# wc -l filelist.txt
20001 filelist.txt
/test# ls -l dir0001
total 0
-rw-r--r-- 1 root root 0 Dec 23 08:36 file081.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file082.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file083.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file084.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file085.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file086.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file087.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file088.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file089.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file090.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file091.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file092.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file093.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file094.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file095.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file096.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file097.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file098.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file099.txt
-rw-r--r-- 1 root root 0 Dec 23 08:36 file100.txt

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22

/test# cat /etc/os-release
NAME="Ubuntu"
VERSION="20.04.3 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.3 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal

/test# xargs --version
xargs (GNU findutils) 4.7.0
Copyright (C) 2019 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <https://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by Eric B. Decker, James Youngman, and Kevin Dalley.