jubatus::core::fv_converter::space_splitter Class Reference

#include <space_splitter.hpp>

Inheritance diagram for jubatus::core::fv_converter::space_splitter:

Collaboration diagram for jubatus::core::fv_converter::space_splitter:

Public Member Functions
void	split (const std::string &string, std::vector< std::pair< size_t, size_t > > &ret_boundaries) const
Public Member Functions inherited from jubatus::core::fv_converter::word_splitter
void	extract (const std::string &text, std::vector< string_feature_element > &result) const
	word_splitter ()
virtual	~word_splitter ()
Public Member Functions inherited from jubatus::core::fv_converter::string_feature
virtual	~string_feature ()

Detailed Description

Definition at line 29 of file space_splitter.hpp.

Member Function Documentation

void jubatus::core::fv_converter::space_splitter::split ( const std::string &  string, std::vector< std::pair< size_t, size_t > > &  ret_boundaries  ) const

virtual

Implements jubatus::core::fv_converter::word_splitter.

Definition at line 33 of file space_splitter.cpp.

                                                               {
  std::vector<std::pair<size_t, size_t> > bounds;

  size_t last = 0;
  while (true) {
    size_t begin = string.find_first_not_of(SPACES, last);
    if (begin == std::string::npos) {
      break;
    }

    size_t end = string.find_first_of(SPACES, begin);
    if (end == std::string::npos) {
      size_t len = string.size() - begin;
      bounds.push_back(std::make_pair(begin, len));
      break;
    } else {
      size_t len = end - begin;
      bounds.push_back(std::make_pair(begin, len));
      last = end;
    }
  }

  bounds.swap(ret_boundaries);
}

---

The documentation for this class was generated from the following files:

• jubatus/core/fv_converter/space_splitter.hpp
• jubatus/core/fv_converter/space_splitter.cpp