Yes, lack of power and they don't get much better economy than the V6, probably about the difference in price between ULP and diesel! At least the D4D Prado has a good auto box - same box as the V6 Hilux (A750F 5spd auto). The diesel Hilux only has a 4spd auto.
The early D4D's have problems though.