File globbing skips files with log at the end of the name...

HalJordan · 2019-10-13 10:06:11

I don't know if there's an easier way to explain this. I'm having issues with logrotate not catching logs with -ssl_log at the end of the name. After some testing, I'm showing that while trying to match all files that don't end with gz, the globbing will exclude files ending in log... I've been doing some testing and pulling my hair out, thinking it was the dash or the hyphen, playing in a trash directory so I don't screw anything up when I stumbled upon this:

(04:54:10 AM) me: hal_j@home ~/testdir % ll 
total 0 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:31 testfile1 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile1log 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile1ssl 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:31 testfile2 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile2log 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile2ssl 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:31 testfile3 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile3log 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile3ssl 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:31 testfile4 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile4log 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile4ssl 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:31 testfile5 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile5log 
-rw-r--r-- 1 hal_j hal_j 0 Oct 13 04:54 testfile5ssl 
hal_j@home ~/testdir % find . -name "*[^gz]"   
. 
./testfile3ssl 
./testfile2ssl 
./testfile4ssl 
./testfile2 
./testfile1ssl 
./testfile5ssl 
./testfile1 
./testfile4 
./testfile5 
./testfile3

I realize there aren't any gz files in there, but it's been properly skipping those. My issue is that it's -also- skipping the -ssl_log files, or more accurately the *log(such as the case here) files when I see no reason that it should be. Is there some obscure(I hope) setting/option/variable that I'm missing that's changing how that globbing works that it automatically skips *log files?

V1del · 2019-10-13 10:15:51

Your globbing on a character group, it will match anything ending with g and/or z, just do

*gz

loqs · 2019-10-13 10:18:34

*[^gz]*

zero or more of anything followed by zero or more not in the set [gz]

Last edited by loqs (2019-10-13 10:19:08)

HalJordan · 2019-10-13 11:17:45

I knew I wasn't being clear enough. Just to reiterate, I have a directory with domlogs from Apache. they're all named for either "domain.tld" or "domain.tld-ssl_log", as they're rotated out, they'll be compressed with .gz at the end of the filename, so I don't want logrotate to work on those only the domain.tld and domain.tld-ssl_log. Hence the globbing I'm using, I want logrotate to match on any file that doesn't end with gz. It's matching on -MOST- of those, but skipping those that end in "log". My globbing doesn't have log anywhere in it. I can't figure out why it's skipping those. I only want it to skip files with gz at the end.

HalJordan · 2019-10-13 11:29:44

Okay, I see what went wrong. This rule was already in place from a coworker, and I was assuming that the globbing worked how they thought it should, where "*[!gz]" excludes anything ending in "gz", when it actually matches anything not ending in "g" -or- "z". I now have it working with:

*[!.][!g][!z]

Now I feel dumb.

Trilby · 2019-10-13 12:10:53

No, that will also not do what you want. Don't try to overthink it, just specify the criteria:

find ! -name '*.gz'

EDIT: for clarity, you rule will match anything that does not have a '.' in the third to last position, not a 'g' in the second to last, and not a 'z' in the last. This is not the same as not a '.gz' in the last three positions. Specifically, all of the following (and many more) would be inappropriately excluded from the result:

Some_filename.do
Some_log.01
HouseRulez
Logs
Progs
PicturesOfFrogs
MyAccount.id
ICanHazCheeseBurgerz
SourceCode.go

Last edited by Trilby (2019-10-13 12:17:12)

HalJordan · 2019-10-13 21:29:51

Find is only used here as an example of what I was seeing in the regex. I need the regex to work IN LOGROTATE for specifying all files in a directory that don't end in gz.

loqs · 2019-10-13 21:54:52

What about the following for matching the contents of your original post

/path/testfile?
/path/testfile?log
/path/testfile?ssl
{
}

If matching using logrotates glob is not possible:
https://paperairoplane.net/posts/exclud … ng-matches

Last edited by loqs (2019-10-13 21:56:14)

Arch Linux

#1 2019-10-13 10:06:11

File globbing skips files with log at the end of the name...

#2 2019-10-13 10:15:51

Re: File globbing skips files with log at the end of the name...

#3 2019-10-13 10:18:34

Re: File globbing skips files with log at the end of the name...

#4 2019-10-13 11:17:45

Re: File globbing skips files with log at the end of the name...

#5 2019-10-13 11:29:44

Re: File globbing skips files with log at the end of the name...

#6 2019-10-13 12:10:53

Re: File globbing skips files with log at the end of the name...

#7 2019-10-13 21:29:51

Re: File globbing skips files with log at the end of the name...

#8 2019-10-13 21:54:52

Re: File globbing skips files with log at the end of the name...

Board footer