Thanks for writing to health care magic.
If a baby has that temperature then he should be admitted for observation and further investigations.
Is your baby active or not?
Is he feeding normally or not?
Intravenous antibiotics suspecting sepsis
should be given after sending investigations.
Continue to ask further queries as required.
Hope this helps.