I believe DuPuy was kicked out of Sweden...though as mentioned below, he had quite a reputation...so he might well have been kicked out of Denmark at one point or another.
From my interview with Peter Bo Bendixen:
"... this character -- Edouard Du Puy -- he was a real living person and he was here... at the theater back in 1801. He came to Copenhagen -- he was kicked out of Sweden because the king got offended when he was singing the Marseilles in Sweden. He pretty much got kicked out everywhere he went, but he was a very, very charming, talented man. One of these people that just have tons of talent -- and he tried to administer all of his talents. He was a fantastic violinist, he was a fantastic singer, he was a composer, he rode as a Life Guard -- we were fighting with the English back then -- and he was a big Don Giovanni. Du Puy actually sang Mozart's Don Giovanni here at the theater!