51

How to remove extra spaces in variable HEAD?

HEAD=" how to remove extra spaces " 

Result:

how to remove extra spaces 
2
  • 1
    Do you really want to remove the whitespace in HEAD, or just provide the expansion of $HEAD without whitespace to another command? The shell provides better tools for controlling the output of expansion than it does tools for just mutating a variable in place. Commented May 6, 2015 at 3:11
  • As you can see here: tr -s " " < file Commented Feb 27, 2019 at 3:27

10 Answers 10

57

Try this:

echo "$HEAD" | tr -s " " 

or maybe you want to save it in a variable:

NEWHEAD=$(echo "$HEAD" | tr -s " ") 

Update

To remove leading and trailing whitespaces, do this:

NEWHEAD=$(echo "$HEAD" | tr -s " ") NEWHEAD=${NEWHEAD%% } NEWHEAD=${NEWHEAD## } 
Sign up to request clarification or add additional context in comments.

5 Comments

Thank. It does not delete the space or at the end or at the beginning of :-(
couldn't you technically just use NEWHEAD=${echo $HEAD}
You can enable shopt -s extglob and then just use NEWHEAD=${NEWHAED/+( )/ } to remove internal spaces.
What's the point of calling tr when you don't quote $HEAD, so bash does word splitting and therefore collapses the whitespace on itself?
In my case I wanted to replace one or more spaces with one tab. Cool, that you can combine the squeeze with a translation: TABBEDHEAD=$(echo "$HEAD" | tr -s " " "\t"). For removing leading/trailing spaces (that are now tabs), see updated answer, but use $'\t' instead of ' ', e.g. TABBEDHEAD=${TABBEDHEAD%%$'\t'}. If you only care about the leading space (my case), you can also just remove the first character: TABBEDHEAD=${TABBEDHEAD:1}.
39

Using awk:

$ echo "$HEAD" | awk '$1=$1' how to remove extra spaces 

1 Comment

The neatest and most accurate answer in this thread.
15

Take advantage of the word-splitting effects of not quoting your variable

$ HEAD=" how to remove extra spaces " $ set -- $HEAD $ HEAD=$* $ echo ">>>$HEAD<<<" >>>how to remove extra spaces<<< 

If you don't want to use the positional paramaters, use an array

ary=($HEAD) HEAD=${ary[@]} echo "$HEAD" 

One dangerous side-effect of not quoting is that filename expansion will be in play. So turn it off first, and re-enable it after:

$ set -f $ set -- $HEAD $ set +f 

2 Comments

This ought to be the accepted answer. This, or the answer from kojiro.
Note that the behavior depends on the value IFS. With the default IFS, namely $' \t\n' you'll also replace tabs and newlines by a space.
11

This horse isn't quite dead yet: Let's keep beating it!*

Read into array

Other people have mentioned read, but since using unquoted expansion may cause undesirable expansions all answers using it can be regarded as more or less the same. You could do

set -f read HEAD <<< $HEAD set +f 

or you could do

read -rd '' -a HEAD <<< "$HEAD" # Assuming the default IFS HEAD="${HEAD[*]}" 

Extended Globbing with Parameter Expansion

$ shopt -s extglob $ HEAD="${HEAD//+( )/ }" HEAD="${HEAD# }" HEAD="${HEAD% }" $ printf '"%s"\n' "$HEAD" "how to remove extra spaces" 

*No horses were actually harmed – this was merely a metaphor for getting six+ diverse answers to a simple question.

4 Comments

This is the only answer that really makes sense here. It's sad ugly hacks and semi-broken answers are upvoted instead…
In honor of this answer (which avoids echo, shell expansion and all the other pitfalls all the other answers went into), I deleted my own incorrect answer.
Two more notes: read needs -r to prevent processing backslash escapes, and -d "" to normalize newlines rather than truncating at first newline. Both options need to be passed before -a.
You introduced an error when applying @MichałGórny's suggestion: read -rd'' -a HEAD will not work, it needs to be read -r -d '' -a HEAD or read -rd '' -a HEAD. Also, IFS should be mentioned, as this will only work if IFS contains the space character.
7

Here's how I would do it with sed:

string=' how to remove extra spaces ' echo "$string" | sed -e 's/ */ /g' -e 's/^ *\(.*\) *$/\1/' => how to remove extra spaces # (no spaces at beginning or end) 

The first sed expression replaces any groups of more than 1 space with a single space, and the second expression removes any trailing or leading spaces.

Comments

3

echo -e " abc \t def "|column -t|tr -s " "

column -t will:

  1. remove the spaces at the beginning and at the end of the line
  2. convert tabs to spaces

tr -s " " will squeeze multiple spaces to single space


BTW, to see the whole output you can use cat - -A: shows you all spacial characters including tabs and EOL:

echo -e " abc \t def "|cat - -A

output: abc ^I def $

echo -e " abc \t def "|column -t|tr -s " "|cat - -A

output: abc def$

Comments

2

Try this one:

echo ' how to remove extra spaces ' | sed 's/^ *//g' | sed 's/$ *//g' | sed 's/ */ /g' 

or

HEAD=" how to remove extra spaces " HEAD=$(echo "$HEAD" | sed 's/^ *//g' | sed 's/$ *//g' | sed 's/ */ /g') 

Comments

2

Whitespace can take the form of both spaces and tabs. Although they are non-printing characters and unseen to us, sed and other tools see them as different forms of whitespace and only operate on what you ask for. ie, if you tell sed to delete x number of spaces, it will do this, but the expression will not match tabs. The inverse is true- supply a tab to sed and it will not match spaces, even if the number of them is equal to those in a tab.

A more extensible solution that will work for removing either/both additional space in the form of spaces and tabs (I've tested mixing both in your specimen variable) is:

echo $HEAD | sed 's/^[[:blank:]]*//g' 

or we can tighten-up @Frontear 's excellent suggestion of using xargs without the tr:

echo $HEAD | xargs 

However, note that xargs would also remove newlines. So if you were to cat a file and pipe it to xargs, all the extra space- including newlines- are removed and everything put on the same line ;-).

Both of the foregoing achieved your desired result in my testing.

Comments

1

I would make use of tr to remove the extra spaces, and xargs to trim the back and front.

TEXT=" This is some text " echo $(echo $TEXT | tr -s " " | xargs) # [...]$ This is some text 

Comments

1

Works in BASH

echo variable without quotes does what you want:

HEAD=" how to remove extra spaces " echo $HEAD # or assign to new variable NEW_HEAD=$(echo $HEAD) echo $NEW_HEAD 

output: how to remove extra spaces

Comments

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.