In 1700-s - Kutsaya Balka, till 1810 - Semenovka, till 1832-
Novopavlovka
Novy Bug on the maps (1930, from the Jewish agricultural colonies south of Ukraine and Crimea.)
In 1828-1857 it was a military colony. In 1860 it became a
townlet (shtetl), there lived 5381 dwellers in 787 homesteads.
In 1910 there was 360 Jewish inhabitants and six synagogues.
I didn't find when the first Jews settled in Novy Bug.
The elder Jewish immigrant from Novy Bug that came to Ellis Island,
Feiga Peres, was born in 1851.
And it's difficult to find the old images of this place - I've put here all I have:
Destroyed German military facilities near Novy Bug (1944)
Monument in honour of WWII fighters (1980)
And here is the list of Jewish immigrants
that came from Novy Bug to USA through Ellis Island 
(thanks to Stephen P. Morse and Michael Tobias for their great search
site)
We can see there a record of Chaim and Chana Millman family that came in
1914 to Chana's brother, Nathan Millman.
Nathan lived in Providence, Rhode Island on Villard Ave., 283.
They left in Novy Bug Chana and Nathan's brother Abram Millman.
My great-great-grandfather Israel Millman was born (probably) and lived
in Novy Bug before he moved to Belaya Tserkov.