The "Details" section of the documentation for ViewPoint states that you can use high values for this option to reduce the distortion due to perspective, which is the effect that bothers you.
However, this is the equivalent of looking at your plot from really far away, so you should then drastically reduce the value of ViewAngle (i.e. the "zoom") to include a much smaller angle than usual, possibly a fraction of a degree, so that your plot is shown at reasonable dimensions.
You may also want to set the BoxRatios option to make your plot look more "square".
In short, take a look at the result below, then tinker with the values of distances in ViewPoint and angles in ViewAngle to obtain the result most pleasing to you.
Plot3D[Exp[-(x^2 + y^2)], {x, -3, 3}, {y, -3, 3}, PlotRange -> All, BoxRatios -> {1, 1, 1}, ColorFunction -> "Rainbow", ViewPoint -> {-150, -160, 50}, ViewAngle -> .5 Degree ]

As you settle on values that work for you, you may consider setting those options once for all your Plot3D functions using SetOptions:
SetOptions[Plot3D, ViewPoint -> {-150, -160, 50}, ViewAngle -> .5 Degree ]
This will influence all the Plot3D expressions you evaluate afterwards in that session.
@GuessWhoItIs pointed out the OP's preference for the built-in ViewPoint position. That can be retained, although I feel that it may result in less "Matlab-like" results. Anyway, one can gauge what multiple of the standard ViewPoint, i.e. how far ViewPoint has to be set, to get rid of perspective-induced distortion with the following series of plots.
In these plots I am trying to obtain results close to what would be obtained with the default options and ViewAngle set at $35\deg$, i.e. the built-in value.
{Style[#, FontSize -> 32, FontFamily -> "Arial Black"], Plot3D[Exp[-(x^2 + y^2)], {x, -3, 3}, {y, -3, 3}, PlotRange -> All, BoxRatios -> {1, 1, .8}, ColorFunction -> "Rainbow", ViewPoint -> # {1.3, -2.4, 2}, ViewAngle -> 30/# Degree, ImageSize -> Medium]} & /@ {1, 2, 5, 10, 20, 50, 75, 100, 200}; Grid@ArrayReshape[%, {3, 3, 2}]
