You can escape ${ with ''${ and subsequently you can use ''\X (replacing X by some character) for inserting a verbatim character, which is necessary because you have a ' before the ${:
''
echo "First value is ''\'''${ARRAY[0]}'."
''
Yes, I know it looks a bit ugly, but you could still use ${"..."} instead to prevent all those single quotes, for example: