concat-files

A shell script that concatenates files from specified paths into larger files, with support for Maven cleaning and file exclusion patterns.

Contributions welcome.

Usage

Usage: ./concat-files/concat-files.sh [--mvnclean] [--shallow|-s] [--excludes|-e ant-pattern]... [path...]
Concatenates files from the specified paths (or current directory if none provided).
Paths can be directories or files:
  directory         Include files recursively from the directory (unless --shallow is active)
  file             Include the specified file directly
Options:
  --mvnclean       Search for pom.xml from each directory and run mvn clean once per unique pom.xml
  --shallow|-s     Include only top-level files from subsequent directories
  --excludes|-e pattern  Exclude files matching the Ant-style path expression (e.g., --excludes **/*.txt)
  --output|-o path/to/file.txt  Specify the output file pattern (e.g., tmp/output.txt --> tmp/output_part1.txt, tmp/output_part2.txt etc.)

Example

./concat-files.sh test/test1 -e **/directory2/* 

This command:

• Concatenates files in test/test1` recusively
• Excludes any files matching **/directory2/*
• Creates files like ./concat-files-part1.txt, ./concat-files-part2.txt, etc., if the total character count exceeds 100,000

The output file(s) will be:

concatenated sources
---------------------------------------------
file test/test1/directory1/fileA.txt:
This is fileA.txt
---------------------------------------------
file test/test1/directory1/fileB.txt:
This is fileB.txt

Each output file starts with a header, followed by sections for each included file, separated by a line of dashes, with a maximum of 100,000 characters per file.

Installation

Add the script as a Git submodule to your project:

git submodule add https://github.com/qudtlib/concat-files concat-files

Then, use it as:

./concat-files/concat-files.sh [options] [paths...]