As you mentioned this might be kidney infection
as well as some spinal problems.
It is very important for you to have simple urine tests performed witch will rule out kidney infection.
and blood tests are advisable as well.
If it will show nothing you should have spinal CT done.
Hope this will help