45

I have some shell scripts created on Windows. I want to run dos2unix on them.

I have read that dos2unix works on Linux.
Is there a way that I can convert my files to having Unix newlines while working on Windows?

8
  • 2
    Install Cygwin to provide a Unix-like environment on Windows. It includes dos2unix Commented Dec 4, 2013 at 6:45
  • 1
    kb.iu.edu/data/acux.html Commented Dec 4, 2013 at 6:46
  • 1
    well I get it resolved by giving absolute filepath Commented Dec 4, 2013 at 7:37
  • 2
    This question appears to be off-topic because it is about has been resolved. OP wasn't specifying the correct path to the file which was causing the error. Commented Dec 4, 2013 at 8:38
  • 3
    @devnull: how you are saying that question is off topic My question is "Anything like DOS2Unix for Windows?" that no one answered. Working on CYGWIN to run DOs2Unix is not "SOmething like DOS2Unix for Windows". Commented Dec 5, 2013 at 3:58

12 Answers 12

57

You can use Notepad++.

The instructions to convert a directory recursively are as follows:

  1. Menu: Search -> Find in Files...
  2. Directory = the directory you want to be converted to Unix format, recursively. E.g., C:\MyDir
  3. Find what = \r\n
  4. Replace with = \n
  5. Search Mode = Extended
  6. Press "Replace in Files"
Sign up to request clarification or add additional context in comments.

3 Comments

the OP asked about command line utilities, not a GUI program. How can you call Notepad++ to replace in shell scripts? And even in Notepad++ you just need to use edit > EOL conversion
@phuclv - I don't see any restriction about the tool to use (CLI or GUI) in the original demand. Also, Notepad++ "Edit > EOL conversion" is a solution for only one file at a time whereas the "Find and replace" can be recursive: in a complex project, it is useful!
I know it's an old post but this solution is super slow (I had to convert 33GB of files). I used dos2unix (sourceforge.net/projects/dos2unix) and it was ~100 times faster.
21

Solved it trough Notepad++.

Go to: Edit -> EOL Conversion -> Unix.

Comments

10

In PowerShell there are so many solutions, given a lot of tools in the .NET platform

With a path to file in $file = 'path\to\file' we can use

[IO.File]::WriteAllText($file, $([IO.File]::ReadAllText($file) -replace "`r`n", "`n")) 

or

(Get-Content $file -Raw).Replace("`r`n","`n") | Set-Content $file -Force 

It's also possible to use -replace "`r", "" instead

To do that for all files just pipe the file list to the above commands:

Get-ChildItem -File -Recurse | % { (Get-Content -Raw ` -Path $_.Fullname).Replace ("`r`n", "`n") | Set-Content -Path $_.Fullname } 

See

For bigger files you may want to use the buffering solutions in Replace CRLF using powershell

Comments

8

If you have perl installed, you can simply run:

perl -i -p -e "s/\r//" <filename> [<filename2> ...] 

Comments

8

There are at least two resources:

  • dos2unix on SourceForge, which appears to be actively maintained (as of 2015), and has pre-compiled releases for Windows, both 32- and 64-bit. Also includes unix2dos, mac2unix, and unix2mac.
  • CygUtils from GnuWin32, which are miscellaneous utilities forked from Cygwin, which includes dos2unix as well as several other related utilities. This package is not actively maintained (last update was in 2008).

Comments

2

I used grepWin:

  • Open the folder containing your files in grepWin
  • In the "Search for" section
    • select "Regex search"
    • Search for -> \r\n
    • Replace with -> \n
  • Hit "Search" to confirm which files will be touched, then "Replace".

Comments

2

Any good text editor on Windows supports saving text files with just line-feed as line termination.

For an automated conversion of text files from DOS/Windows to UNIX line endings the batch file JREPL.BAT can be used which is written by Dave Benham and is a batch file / JScript hybrid to run a regular expression replace on a file using JScript working even on Windows XP.

A single file can be converted from DOS/Windows to UNIX using for example:

jrepl.bat "\r" "" /M /F "Name of File to Modify" /O - 

In this case all carriage returns are removed from the file to modify. It would be of course also possible to use "\r\n" as search string and "\n" as replace string to remove only a carriage return left to a line-feed if the file contains carriage returns also somewhere else which should not be removed on conversion of the line terminators.

Multiple files of a directory or an entire directory tree can be converted from DOS/Windows to UNIX text files by using command FOR to CALL batch file JREPL.BAT on each file matching a wildcard pattern.

Batch file example to convert all *.sh files in current directory from DOS/Windows to UNIX.

@for %%I in (*.sh) do @call "%~dp0jrepl.bat" "\r" "" /M /F "%%I" /O - 

The batch file JREPL.BAT must be stored in same directory as the batch file containing this command line.

For understanding the used commands and how they work, open a command prompt window, execute there the following commands, and read entirely all help pages displayed for each command very carefully.

  • jrepl.bat /?
  • call /?
  • for /?

Comments

2

I realize this may be a bit of a contextual leap, but I'll share my thought anyway since it just helped in my use case...

If the file will live in a git repo, you can enforce the line endings on it via a .gitattributes file. See: how to make git not change line endings for one particular file?

Comments

1

You are using a very old dos2unix version on Cygwin. Cygwin 1.7 changed to a new version of dos2unix, the same as is shipped with most Linux distributions, about two years ago. So update your dos2unix with Cygwin's setup program. Check you get version 6.0.3.

There are also native Windows ports of dos2unix available (win32 and win64). See http://waterlan.home.xs4all.nl/dos2unix.html

regards,

Comments

1

The search and replace Regex didn't work for me for whatever reason, however solved on single file (~/.bashrc) in Notepad++ by setting Encoding --> UTF-8 and resaving. Not as scalable but hopefully saves some headaches for quick conversion.

Comments

0
  • Open the mvnw file using Notepad++
  • Hit Ctrl+F
  • Select search mode as "Regular Expression"
  • Search for -> \r\n
  • Replace with -> \n
  • Hit "Replace all" under the "Replace tab"

if the above doesn't work - mvn clean install

1 Comment

what are mvnw and how are they related to this question? And Notepad++ isn't a command line tool like dos2unix
-1

To create a script that finds all files with CRLF line endings and converts them one by one to LF, you can use a combination of find, file, grep, and a loop. Here's a step-by-step script:

#!/bin/bash # Directory to search SEARCH_DIR="/path/to/search" # Find files with CRLF line endings and process each file find "$SEARCH_DIR" -type f -exec file "{}" + | grep "CRLF" | while read -r line; do # Extract file path from the line file_path=$(echo "$line" | cut -d: -f1) # Print file being processed (optional) echo "Processing $file_path" # Convert CRLF to LF dos2unix "$file_path" done 

1 Comment

the question implies that dos2unix isn't available. if find, file or grep is available then the OP already has some POSIX subsystem available, and dos2unix is also there

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.