Is that anything like "kochanie" or is "mój drogi" just a more friendly way to speak to a friend?
You need to check the intonation and facial expression when sb is saying mój drogi to you coz it can be either romantic or friendly.
I suppose you got a friendly one but it may be a good start for a romantic development.