Note that information I describe here can be found at FAQ page of TRAMP user manual, see here. From an hour of digging, I discovered that tramp is really specific in term of how it read terminal prompt (aka PS1 environment variable.). It also limited in types of terminal, specified by TERM environment variables. TERM must match tramp terminal default setting (tramp-terminal-type). I am using zsh shell in my remote compute.