jubatus::core::fv_converter::word_splitter Class Reference

#include <word_splitter.hpp>

Inheritance diagram for jubatus::core::fv_converter::word_splitter:

Collaboration diagram for jubatus::core::fv_converter::word_splitter:

Public Member Functions
void	extract (const std::string &text, std::vector< string_feature_element > &result) const
virtual void	split (const std::string &string, std::vector< std::pair< size_t, size_t > > &ret_boundaries) const =0
	word_splitter ()
virtual	~word_splitter ()
Public Member Functions inherited from jubatus::core::fv_converter::string_feature
virtual	~string_feature ()

Detailed Description

Definition at line 30 of file word_splitter.hpp.

Constructor & Destructor Documentation

jubatus::core::fv_converter::word_splitter::word_splitter ( )

inline

Definition at line 32 of file word_splitter.hpp.

                  {
  }

virtual jubatus::core::fv_converter::word_splitter::~word_splitter ( )

inlinevirtual

Definition at line 34 of file word_splitter.hpp.

                           {
  }

Member Function Documentation

void jubatus::core::fv_converter::word_splitter::extract ( const std::string &  text, std::vector< string_feature_element > &  result  ) const

virtual

Implements jubatus::core::fv_converter::string_feature.

Definition at line 27 of file word_splitter.cpp.

References split().

                                                     {
  std::vector<std::pair<size_t, size_t> > boundaries;
  split(text, boundaries);

  std::vector<string_feature_element> elements;
  for (size_t i = 0; i < boundaries.size(); ++i) {
    size_t begin = boundaries[i].first;
    size_t length = boundaries[i].second;
    elements.push_back(
        string_feature_element(
            begin,
            length,
            text.substr(begin, length),
            1.0));
  }
  elements.swap(result);
}

Here is the call graph for this function:

virtual void jubatus::core::fv_converter::word_splitter::split ( const std::string &  string, std::vector< std::pair< size_t, size_t > > &  ret_boundaries  ) const

pure virtual

Implemented in jubatus::core::fv_converter::regexp_splitter, jubatus::core::fv_converter::character_ngram, jubatus::core::fv_converter::regexp_splitter, jubatus::core::fv_converter::regexp_splitter, jubatus::core::fv_converter::space_splitter, and jubatus::core::fv_converter::without_split.

Referenced by extract().

Here is the caller graph for this function:

---

The documentation for this class was generated from the following files:

• jubatus/core/fv_converter/word_splitter.hpp
• jubatus/core/fv_converter/word_splitter.cpp