Are there papers in the literature that address the following object detection task ?

The task can be described as follows:

  • Given a set of images, the labels are just coordinates (x,y) that represent the object locations that we wish to detect. A coordinate is not necessarily at the centre of the object and the object can be of any size.

  • The task is to detect an object that is either a person, a boat, or a car. However, the labels do not state the category of the objects, the labels are simply coordinates that are close to the objects of interest.

  • The images are taken every hour and they are snapshots of the same scene; therefore, background subtraction techniques might help.

  • There are around 2000 images of the same scene and each image usually has 2 objects of interest.

I am wondering if such task has been approached before ?

Hog features and SVM have shown great success in detecting humans in images. But the relevant literature use training data where the objects of interest are labelled using a bounding box instead of a single coordinate.

The three main challenges are:

  • Choosing the bounding box for the classifier is difficult since objects can be of any size.
  • snapshots of the scene is taken every hour (camera can move slightly as well); so using background subtraction isn't straightforward.
  • we don't have much labelled data.

It would be interesting to see how people dealt with these challenges.


  • $\begingroup$ Sounds like just object detection and localization. What research have you done? Have you read about those subjects? Is there some reason you don't believe this is an instance of that, or you don't find that an acceptable answer to you question? $\endgroup$ – D.W. Aug 14 '16 at 4:48
  • $\begingroup$ While researching on this topic I didn't find a research paper where the object labels are given as coordinates instead of (1) a bounding box or (2) pixel-wise labels. Coordinate labelling makes it harder for image processing algorithms to recognise objects but easier for humans to label objects. But I guess I can use cross-validation to determine the best bounding box for each labelled object. It would be helpful to have a reference to a research paper where the dataset has similar labelling mechanism. @nbubis has a great answer, but the papers he posted have nicer datasets. $\endgroup$ – Curious Aug 16 '16 at 0:27

The state of the art in such problems is done these days via deep neural networks. Among others, two popular and recent approaches for solving the problem of detection and localization of objects are the YOLO paper, and the faster-RCNN, which run a classifier over many variously sized regions in an image.

As humans, boats and cars are popular object classes, I'd first attempt to see what existing pre-trained networks can do for your problem, and then, if needed, try and re-train them using your data.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.