[BMC Remedy AR System] the Pulse_ FTS Fortific..

16
MC Remedy AR System Share: | Introduction This blog post applies to FTS in AR System Server versions 7.6.04, 8.0 and 8.1 only. Full Text reindexing can take a very long time, several days in some cases. We suspect that too much data is being reindexed and it's likely that some data is indexed that won't even be searched for. Also, for general FTS problems such as a Full Text reindex not completing or problems with the Index itself, these steps may help. These steps will bring FTS to a known good state with latest fixes. It comprises of 3 steps, which are: Step 1 Fortifying the forms for FTS Settings Step 2 Configuring for Performance in a Server Group Step 3 Applying the Relevant Hotfix Bundles All steps within can be performed on the following minimum versions; 7.6.04 SP2, 8.0 patch 3 and 8.1 base version. You don’t need to perform all steps if you don’t wish to, but it is recommended. If you are not on the minimum SP/patch level required, you can still perform some steps as per the table below: Version Step 1 Step 2 Step 3 7.6.04 SP0 & SP1 Yes Yes No 7.6.04 SP2 Yes Yes Yes 8.0 patch 0, patch 1 & patch 2 Yes Yes No 8.0 patch 3 Yes Yes Yes 8.1 patch 0 & patch 1 Yes Yes Yes Hotfix bundles exist only for 7.6.04 SP2+, 8.0 patch 3 and 8.1 base version. NOTE: If you perform all these steps and then apply a later SP for ITSM, SRM or RKM, then you’ll need to re run Step 1. The Pulse: FTS Fortification Posted by David Still in BMC Remedy AR System on Aug 30, 2013 11:18:42 AM 0 1 Google + 0 0 1 Buffer

description

: [BMC Remedy AR System] The Pulse_ FTS Fortific...pdf

Transcript of [BMC Remedy AR System] the Pulse_ FTS Fortific..

Page 1: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 1/16

MC Remedy AR System

Share: |

Introduction This blog post applies to FTS in AR System Server versions 7.6.04, 8.0 and 8.1 only. Full Text re­indexing can take a very long time, several days in some cases. We suspect that too much data is beingre­indexed and it's likely that some data is indexed that won't even be searched for. Also, for general FTS problemssuch as a Full Text re­index not completing or problems with the Index itself, these steps may help. These steps willbring FTS to a known good state with latest fixes. It comprises of 3 steps, which are:

Step 1 ­ Fortifying the forms for FTS Settings

Step 2 ­ Configuring for Performance in a Server Group

Step 3 ­ Applying the Relevant Hotfix Bundles

All steps within can be performed on the following minimum versions; 7.6.04 SP2, 8.0 patch 3 and 8.1 base version.You don’t need to perform all steps if you don’t wish to, but it is recommended. If you are not on the minimum SP/patch level required, you can still perform some steps as per the table below:

Version Step 1 Step 2 Step 37.6.04 SP0 & SP1 Yes Yes No7.6.04 SP2 Yes Yes Yes

8.0 patch 0, patch 1 & patch 2 Yes Yes No8.0 patch 3 Yes Yes Yes8.1 patch 0 & patch 1 Yes Yes Yes

Hotfix bundles exist only for 7.6.04 SP2+, 8.0 patch 3 and 8.1 base version. NOTE: If you perform all these steps and then apply a later SP for ITSM, SRM or RKM, then you’ll need to re­run Step 1.

The Pulse: FTS FortificationPosted by David Still in BMC Remedy AR System on Aug 30, 2013 11:18:42 AM

0 1Google + 0 0 1Buffer

Page 2: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 2/16

Step 1 ­ Fortifying the forms for FTS Settings Use the ApplyFTS_bundle.zip file (attached to this blog post) to make changes to the forms.Running this utility will remove all unwanted FTS and MFS indexes from all forms and fields (detailed in thereferenced csv files). Follow the detailed steps in the FTS Fortification – Java Commands Word doc also attached. Review the notes under each of the Java commands and also review the output files after you execute each of theJava commands to verify that the changes you’re making are successful.If you need to manually remove some FTS settings to fields in forms, there are additional steps in Appendix A of theWord doc that detail how to do this. NOTE: Is important to Disable the FTS Indexer and Disable FTS Searching before you start. Changing theforms will put rows into the ft_pending table to mark some of the records for deletion, which could take a longtime to complete in some cases. There are 2 reference csv files within the ApplyFTS_bundle.zip:

Version File

7.6.04 FTSMustHaves7604SP2_updated.csv8.0 & 8.1 FTSMustHaves80_updated.csv

NOTE: Take note of the 'Recache Delay (seconds)' setting you have set (Server Information form ­>Configuration tab)/ Delay­Recache­Time parameter in the ar.cfg/conf. Running the Java commands in points 5, 6, 8, 10 in the HowToUseUtil.txt file are Admin Changes, and this settingneeds to be taken into account. (Wait for the amount of time you have set before performing the next Admin Change) NOTE: If you’re running these steps on a Server group environment, perform this on/connecting to the AdminServer. NOTE: Customizations ­ For Java command 2, the report will include custom indexes and Out­Of­Box indexes. If you need to keep any of your custom FT Indexed fields, remove them from the report(report_custom_fields.log) before executing Java command 6. The steps were tested and verified on the following environments. 7.6.04:

7.6.04_report_input_1.zip 7.6.04_report_input_2.zipARS: 7.6.04 SP5

OS: Windows 2008DB: MS­SQL 2012

ARS: 7.6.04 SP5OS: Windows 2008DB: MS­SQL 2012

Page 3: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 3/16

CMDB: 7.6.04 SP4ITSM: 7.6.04 SP4RKM: 7.6.04SRM: 7.6.04SLM: 7.6.04

CMDB: 7.6.04 SP5ITSM: 7.6.04 SP4RKM: 7.6.04 SP4SRM: 7.6.04 SP4SLM: 7.6.04 SP1

8.1:

8.1_report_input_1.zip 8.1_report_input_2.zipARS: 8.1

OS: Windows 2008DB: MS­SQL 2012

CMDB: 8.1ITSM: 8.1SRM: 8.1SLM: 8.1

ARS: 8.1 SP0 patch 2OS: Windows 2008DB: MS­SQL 2012

CMDB: 8.1 SP0 patch 0ITSM: 8.1 SP0 patch 2SRM: 8.1 patch 2

SLM: 8.1

(I may test on more environments and 8.0 at a later date and add to this table) The report and input files generated for these 2 environments are included in 2 additional zip files attached. If not moving onto Step 2 or Step 3:

1. Clean out the collection directory

2. Truncate the ft_pending table using an SQL tool

3. Enable the FTS Indexer

4. Re­index.

Once done, enable FTS Searching. NOTE: If you are on 7.6.04 or 8.0 (check ITSM & SRM patches for 8.0) and you perform this step, then apply alater SP to ITSM, RKM or SRM, you will need to re­run this step.

Step 2 ­ Configuring for Performance in a Server Group If you have a Server Group environment ­ and if you haven't already done so, follow the steps in the wiki docs toconfigure the environment for FTS Performance in a Server Group. Version Link7.6.04 &8.0

https://docs.bmc.com/docs/display/public/ars8000/Tuning+FTS+for+performance+and+stability+in+a+server+group

8.1 https://docs.bmc.com/docs/display/ars81/Configuring+full+text+search+for+a+server+grouphttps://docs.bmc.com/docs/display/ars81/FTS+Configuration+form+in+the+AR+System+Administration+Console

Page 4: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 4/16

Even though this contains a lot of information, in a nutshell ­ the collection directory should be local to every FTSJava Plugin Server. Therefore, we configure a single Reader and a single Writer instance of the FTS Java Pluginserver on the Primary FTS Server; then configure the other servers to point to the Reader plugin. In 8.1, functionality was added to make this process easier (AR System Administration Console ­> System ­> General­> FTS Configuration). In 7.6.04 SP5, this same functionality is now available as well as High Availability (also available in 8.1.01 andabove)

FTS Configuration functionality in 8.1 and 7.6.04 SP5

NOTE: Re­indexing is required as part of this step, to populate the Collection directory on the FTS plugin Servermachine.This is why the forms were changed in the previous step ­ to reduce the time it takes to perform a re­index.

Prior to performing a re­index:

Page 5: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 5/16

1. Clean out the collection directory

2. Truncate the ft_pending table using an SQL tool

3. Enable the FTS Indexer

4. Re­index.

Step 3 ­ Applying the Relevant Hotfix Bundles Acquire the latest hotfix bundles for the version of AR System Server that you have. You will need to raise a support issue for this ­ and the files will be placed on the ftp site for you.When raising the support issue, include the link to this blog post or reference KA395757 . NOTE: For a Server Group environment you’ll need to copy the AR Server hotfix to each server in the group. Ifyou have followed the documentation for Configuring FTS for Performance in Server Group you will need tocopy the FTS Java Plugin hotfix to both the Primary and Secondary plugin directories. After gathering the Hotfix bundles, review the README files within the zip for the instructions on how toimplement the hotfixes.In most cases, it will simply be a case of replacing the old file with the new file ­ remember to stop the Remedy serverprior to doing this, and always take a backup of the files that you are replacing. The files needed are: AR Server Hotfix Bundle

Version File7.6.04 SP2 SR_7604SP2_2013<MMMDD>_CU_WIN.zip7.6.04 SP3 SR_7604SP3_2013<MMMDD>_CU_WIN.zip7.6.04 SP4 SR_7604SP4_2013<MMMDD>_CU_WIN.zip8.0 patch3 SR_8000P3_2013<MMMDD>_CU_WIN.zip8.1 SR_8100_2013<MMMDD>_CU_WIN.zip

FTS Plugin Hotfix Bundle

Version File7.6.04 SP2 SF_7604SP2_2013<MMMDD>_CU_ALL.zip7.6.04 SP3 SF_7604SP3_2013<MMMDD>_CU_ALL.zip7.6.04 SP4 SF_7604SP4_2013<MMMDD>_CU_ALL.zip8.0 patch3 SF_8000_2013<MMMDD>_CU_ALL.zip8.1 SF_8100_2013<MMMDD>_CU_ALL.zip

RKM

Version Defects7.6.04 SP<all> SW00415402 – Manual fix to a form

Page 6: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 6/16

SW00420061 – Manual fix to a form & fixed in RKM 7.6.04SP4

8.0 SW00415402 – Manual fix to a form8.1 SW00415402 – Manual fix to a form

Dev Studio

Version File

7.6.04 SP4 only DS_7604SP4_2013<MMMDD>_CU_ALL.zip8.0 patch3 DS_8000P3_2013<MMMDD>_CU_ALL.zip8.1 DS_8100_2013<MMMDD>_CU_ALL.zip EDIT:The FTSMustHaves80_updated.csv file in the ApplyFTS_Bundle.zip file attached to this article has been updated.This new file contains 34 new entries for the SRM:Request form to address defect SW00466536. NOTE: These 34 entries are not required for the 7.6.04 csv reference file.The 8.1_report_input zip files still contain the test results when using the original FTSMustHaves80_updated.csv EDIT:A new zip file has been created that includes a new jar file (for customers who use 8.1.01 and above only) and theupdated FTSMustHaves80_updated.csv file.It's called ApplyFTS_Bundle_8.1.01_or_Later.zip.

7599 Views Categories: Best Practices, Tips and Techniques, UtilitiesTags: ars, fts, arserver, ft_pending, fortification, ar_system, customer_support, pulse

FTS Fortification – Java Commands.docx

28.7 K

7.6.04_report_input_1.zip

16.4 K

7.6.04_report_input_2.zip

9.8 K

8.1_report_input_1.zip

12.1 K

8.1_report_input_2.zip

9.9 K

ApplyFTS_Bundle_8.1.01_or_Later.zip

8.5 MB

ApplyFTS_Bundle.zip

7.1 MB

Page 7: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 7/16

Average User Rating

(2 ratings) MOST LIKED

Login or Register to comment

53 Comments

Great blog

Kiran Hullule Sep 4, 2013 3:57 AM

Like (2)Actions

Good info

Rahul Parekar Sep 4, 2013 3:59 AM

Like (1)Actions

Thanks David, this is great !

Paul Batchelor Sep 4, 2013 4:42 AM

Like (2)Actions

Thank you David! I love that we are seeing these types of articles that help unravel the mystery andsecrets of AR System and its related products. Please keep up the great work

Jason Miller Sep 5, 2013 11:29 AM

Like (3)Actions

Hi Jason, I'm one of the customer support managers at BMC, keep an eye out for all of ourblog articles with 'The Pulse' in the title in our Remedy and Atrium communities. We aregetting great feedback and will be continuing to develop further 'Pulse' articles from our BMCtechnical community into the Remedy communities and many other of our product linescommunities also. Any suggestions on topics, please let me know. Thanks Paul

Paul Batchelor Sep 6, 2013 5:15 AM (in response to Jason Miller)

Like (5)Actions

Love it! Thank you! Should we start a doc where customers can propose future topics?

Jason Miller Sep 6, 2013 10:18 PM (in response to Paul Batchelor)

Like (1)Actions

Hi Jason,

Paul Batchelor Sep 10, 2013 12:35 PM (in response to Jason Miller)

Page 8: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 8/16

I've been chatting with our community champions about how best to goabout gathering ideas for future 'pulse' topics. We are going to look atcreating some 'polls' within the product communities to gather feedback onfuture topics. I'll loop back with David Still and make this happen.

Like (1)Actions

Oooo! I have one... Server Groups!!! I have been avoiding setting up a SG untilthey matured. Our organization is just about to the point where we need to startsetting up a SG. I remember a time years ago when I was advised it couldn't be done without helpfrom Support. I don't think that is the case any longer but I am sure there is a lot ofexperience Support could share on the subject.

Jason Miller Nov 22, 2013 10:52 AM (in response to Paul Batchelor)

Like (0)Actions

Nice doc! Setting up SG is quite easy to setup from 7.6.04. There are some littletips&tricks to know during ARS servers installations in SG (disconnectSG, IPs / DNS with Server­Plugin­alias, architecture, post­installationconfiguration).I made a documentation for a customer 2 years ago for 7.6.04 and it hasbeen widely used by my collegues since for other projects (5 or 6). It takesabout 15 minutes to setup a SG once all ARS servers are installed. I guess it changed a little in 8.1 since SG is activated by default and theFTS plugin architecture changed but well...

Laurent Matheo Sep 9, 2013 1:26 AM (in response to Jason Miller)

Like (2)Actions

That is my point, there are tricks one needs to know. Yourcolleagues have the document you created. Without that issounds like there are still some items that are not obvious just byreading the documentation.

Jason Miller Sep 9, 2013 1:31 AM (in response to Laurent Matheo)

Like (1)Actions

Indeed. It's much better in 8.x than it was on 7.6.04, IDDteam made a big effort on it.

Laurent Matheo Sep 9, 2013 1:35 AM (in response to JasonMiller)

Like (2)Actions

Thanks Jason and Laurent for the discussion. I'llhave a chat with our tech leads and find out

Paul Batchelor Sep 9, 2013 4:57 AM (in response toLaurent Matheo)

Page 9: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010p… 9/16

whether this is an article we can put together.

Like (4)Actions

We applied the fortification steps and started the reindexing and saw ft_pending showed around 18forms with the operationtype 10.After one month we had a scenario where we had to reindex again. So, when we initiated reindexing,we saw join forms in the ft_pending table. (It showed 63 entries with the operation type 10).We never touched those join forms during this one month. We are wondering how could this bepossible?Did anyone experience this kind of issue?Do we need to run the fortification steps every time we need to reindex?

NARESH GANNAMANENI Mar 19, 2014 5:39 PM

Like (0)Actions

No, you should not have to perform the fortification steps every time you reindex. There issomething else going on. For one, looking at the records in ft_pending is not an exactscience unless you track the SQL statements that are executed to manage the records. For example, one could start the reindex, take a few seconds to look the at the records inft_pending, and not realize that some forms with very few records could have come andgone already, providing an inaccurate count of how many forms are being reindexed. Butwith that said, the difference you are seeing is most likely not because of the timing of whenyou looked. Any chance you had FT Indexer logging on during any of this process? Itwould help you to see a list of the forms the server thinks are involved in indexing, like thelist that is included in the FT Indexer log when the server starts up. This could also helppoint out if there are form overlays involved that could be a factor in this mystery. Withsome more investigation you may be able to get to the bottom of this.

Bob Poulos Mar 20, 2014 1:21 AM (in response to NARESH GANNAMANENI)

Like (0)Actions

If your environment is pre 7604 sp5 & 8.1 sp1 then your FTS indexer thread (390602) mustbe set to single threaded , can you check that too.

Kiran Hullule Mar 20, 2014 4:01 AM (in response to NARESH GANNAMANENI)

Like (0)Actions

It is recommended in general that 390602 be set to a single thread unless there areperformance reasons. This thread only affects indexing and at the end of the line,there is only 1 thread that will index into the collection.

David Baldwin Mar 20, 2014 3:15 PM (in response to Kiran Hullule)

Like (0)Actions

we are currently on 7604 sp4. It used to be single threaded in our CERT environment but we changedto two threads by adding a line to the ar.conf file. (Private­RPC­Socket: 390602 2 2) to improvethe speed of the FTS reindexing. Does the addition of that config change could do that?

NARESH GANNAMANENI Mar 21, 2014 2:47 PM

Like (0)Actions

No, the number of indexing threads has nothing to do with how many forms the server

Bob Poulos Mar 21, 2014 2:55 PM (in response to NARESH GANNAMANENI)

Page 10: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 10/16

chooses to reindex. I think we are getting off track here discussing the FT Indexer threadqueue.

Like (0)Actions

I also went into the Help Desk Classic Join form and checked the field properties of some of thefields described below and saw that there was no FTS property defined for them (Which would beunder Database properties), but still they are being pulled up in the fortification report and also I sawthe form in the ft_pending table when it is processing the records (we can see how many records thatft indexer processed in UPDATETIME column when the operation type is ­10).HPD:Help Desk Classic,179,false,InstanceId,,falseHPD:Help Desk Classic,200000003,false,ProductCategoryTier1,,falseHPD:Help Desk Classic,200000004,false,ProductCategoryTier2,,falseHPD:Help Desk Classic,200000005,false,ProductCategoryTier3,,falseHPD:Help Desk Classic,200000007,false,SiteGroup,,falseHPD:Help Desk Classic,200000012,false,Region,,falseHPD:Help Desk Classic,240001002,false,ProductName,,falseHPD:Help Desk Classic,240001003,false,Manufacturer,,falseHPD:Help Desk Classic,240001005,false,ModelVersion,,falseHPD:Help Desk Classic,260000001,false,Site,,falseHPD:Help Desk Classic,303497300,false,ServiceCategory,,falseHPD:Help Desk Classic,1000000063,false,OperationalCategoryTier1,,falseHPD:Help Desk Classic,1000000064,false,OperationalCategoryTier2,,falseHPD:Help Desk Classic,1000000065,false,OperationalCategoryTier3,,falseHPD:Help Desk Classic,1000000082,false,Company,,falseHPD:Help Desk Classic,1000000161,false,ArticleId,,falseAbove fields are captured by running the first two reports in the fortification process. The above linesare from the report "create report of all fields that that should not be index for FTS or MFS basedon master file."

NARESH GANNAMANENI Mar 21, 2014 4:17 PM

Like (0)Actions

From reading above it soulds like this does not need to be applied in ARS 8.1 SP1 is that correct? The reason I ask is we have an environment that is 8.1 pre­sp1 with the fortification applied. Icompared that to our 8.1 SP1 envionment and there are many fields that are FTS indexed in the SP1environment that are not indexed in the fortified environment

Jeff Aalto Mar 31, 2014 1:44 PM

Like (0)Actions

Apologies for the delay Jeff ­ FTS Fortification still needs to be applied from 8.1 SP1onwards. We'll let you know when it will no longer be needed to run (more than likely a futuremajor version now). The article has been updated, apologies for any confusion caused.

David Still Nov 6, 2014 7:59 AM (in response to Jeff Aalto)

Like (1)Actions

Is this relevant for 8.1 SP2 or have the fixes been applied?

Heather Leventry Nov 6, 2014 8:28 AM

Like (1)Actions

David Still Nov 7, 2014 7:55 AM (in response to Heather Leventry)

Page 11: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 11/16

You'll still need to run it on 8.1 SP2 as per my above comment.

Like (1)Actions

Hi David Still what about Remedy 9.0?Does FTS Fortification still needs to be applied on 9.0?

Luciano Muller Nicoletti Jun 5, 2015 2:52 PM (in response to David Still)

Like (3)Actions

Sameer Mardhekar would you be able to answer the query from@Luciano?

Ashley Hall Jul 14, 2015 6:30 AM (in response to Luciano Muller Nicoletti)

Like (1)Actions

Hi David, I'm getting RPC timeout on ARS 8.1.02 while performing step 11 and file report_all_forms_final.logis not generated. Is there anything I can change in the configuration to prevent it from happening? Main: ERROR (91): RPC call failed; ONC/RPC call timed outERROR (91): RPC call failed; ONC/RPC call timed out at com.bmc.arsys.apitransport.ApiProxyJRpcBase.a(Unknown Source) at com.bmc.arsys.apitransport.ApiProxyJRpcBase.a(Unknown Source) at com.bmc.arsys.apitransport.ApiProxyJRpcBase.convertException(Unknown Source) at com.bmc.arsys.api.ProxyJRpc.getRpcClient(Unknown Source) at com.bmc.arsys.api.ProxyJRpc.<init>(Unknown Source) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at com.bmc.arsys.apitransport.connection.b.a(Unknown Source) at com.bmc.arsys.apitransport.connection.b.createProxy(Unknown Source) at com.bmc.arsys.api.ProxyManager.createProxy(Unknown Source) at com.bmc.arsys.api.ProxyPool.createProxy(Unknown Source) at com.bmc.arsys.apitransport.connection.a.get(Unknown Source) at com.bmc.arsys.apitransport.connection.c.getProxy(Unknown Source) at com.bmc.arsys.api.PoolingProxyManager.getProxy(Unknown Source) at com.bmc.arsys.apitransport.connection.c.getProxy(Unknown Source) at com.bmc.arsys.api.ARServerUser.usePrivateRpcQueue(Unknown Source) at com.bmc.tests.ApplyFTS_ToAllFields_New3.main(ApplyFTS_ToAllFields_New3.java:103)

Ariel Manka Dec 21, 2014 3:34 AM

Like (0)Actions

Hi Ariel,Please raise a support issue to have this investigated

David Still Dec 29, 2014 10:49 AM (in response to Ariel Manka)

Like (0)Actions

Page 12: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 12/16

I know Smart IT added some new FTS indexes. I'd love to see this process updated to supportSmart IT specifically.

Evan Ruble Feb 6, 2015 1:09 PM

Like (1)Actions

Hi all, I'm getting the error bellow when running step 6, any ideias?The step:6 Clear all FTS and MFS field settings for fields that should not have FTS or MFS

settings using file generated in step 2the error: Main: nulljava.lang.NullPointerException atcom.bmc.tests.ApplyFTS_ToAllFields_New3.ClearFieldProperties(ApplyFTS_ToAllFields_New3.java:1179) atcom.bmc.tests.ApplyFTS_ToAllFields_New3.ClearFTSProperties(ApplyFTS_ToAllFields_New3.java:1097) at com.bmc.tests.ApplyFTS_ToAllFields_New3.main(ApplyFTS_ToAllFields_New3.java:430) Thank you

Liliana Falcao Feb 25, 2015 9:28 AM

Like (0)Actions

Please raise a support issue so that the Remedy support team can investigate & assist.

David Still Feb 26, 2015 3:31 PM (in response to Liliana Falcao)

Like (0)Actions

Hi David Still is there a hotfix bundle for 7.6.04 SP5?

Laurent Matheo Mar 6, 2015 3:46 AM (in response to David Still)

Like (0)Actions

There is indeed Laurent Matheo, support will provide it to you when youraise an issue.

David Still Mar 6, 2015 7:32 AM (in response to Laurent Matheo)

Like (1)Actions

Cool, thanks a lot ^_^

Laurent Matheo Mar 6, 2015 7:36 AM (in response to David Still)

Like (0)Actions

Hi,

Greg Whitney May 4, 2015 3:20 PM (in response to Liliana Falcao)

Page 13: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 13/16

For me the issue was that I was using the wrong version of the utility. We are on 8.1.00 but,in contradiction to the file name, we needed to use ApplyFTS_Bundle_8.1.01_or_Later.zip. Itwas explained by support that this is becuase of the granular overlays introduced in 8.1.00which only the later version of the utility can handle. HTH!

Like (0)Actions

Great post!

Luciano Muller Nicoletti Apr 17, 2015 3:55 AM

Like (2)Actions

David Still, thanks for this ­ please could you confirm that this doc is the latest source ofdocumentation/fortification tool or whether the latest version should always be sought via Support?

Ashley Hall May 29, 2015 4:55 AM

Like (1)Actions

I've used this doc and improved the FTS performance, disk space, etc. on 7.6.04 and 8.1

Luciano Muller Nicoletti May 29, 2015 5:29 AM (in response to Ashley Hall)

Like (1)Actions

After running this, on some of the fields, I still have the Full Text MFS Categories set when runningthe final report: PBM:Pbm Search­Associations,179,,InstanceId,,,PBM:Pbm Search­Associations,200000003,,ProductCategoryTier1,,,PBM:Pbm Search­Worklog,179,,InstanceId,,,PBM:Pbm Search­Worklog,200000003,,ProductCategoryTier1,,,PBM:ProblemInterface,200000003,,ProductCategoryTier1,,,PBM:ProblemInterface,200000004,,ProductCategoryTier2,,,PBM:ProblemInterface,200000005,,ProductCategoryTier3,,, The forms themselves are not in the output, Index for FTS is set to None, so is it OK to remove thecategories for these forms as well? Does it impact performance either way?

Ryan Kountz Jun 2, 2015 10:13 AM

Like (0)Actions

As far as I know they are RKM forms and the fields listed with MFS category are must tohave MFS category for global or RKM search. I would recommend you keep it.

Kiran Hullule Jun 2, 2015 10:17 AM (in response to Ryan Kountz)

Like (0)Actions

Ryan Kountz, I don't believe that any of the Forms that you have mentioned are used forGlobal or Knowledge Search, therefore see no reason why they cannot be removed.

Ashley Hall Jun 2, 2015 10:19 AM (in response to Ryan Kountz)

Like (0)Actions

Page 14: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 14/16

Sameer Mardhekar Ashley Hall David Still I have an environment 8.1.02. I have upgraded from 8.1.00 I would like to know if there is need to perform FTS fortification ?? if yes, please let me know theway....

NR Godale Jul 21, 2015 2:02 AM

Like (0)Actions

You may need to run FTS fortification with 8.1 sp2 too , at least create a report of all fieldsthat that should not be index for FTS or MFS enabled, this will give you an idea whetherfortification is needed or not.

Kiran Hullule Jul 21, 2015 3:27 AM (in response to NR Godale)

Like (1)Actions

hello Kiran,Thanks for the reply...I need more info. I have no idea how to run the report. will you please share the details how to run thereport and also let me know if the report results in need of fortification then how toget this done ?

NR Godale Jul 21, 2015 3:39 AM (in response to Kiran Hullule)

Like (0)Actions

Everything is explained on this post : The Pulse: FTS Fortification

Luciano Muller Nicoletti Jul 21, 2015 3:41 AM (in response to NR Godale)

Like (0)Actions

are these steps valid for version 8.1.02 and above ?? coz the blogger mentioned that This blog post applies to FTS in AR System Server versions7.6.04, 8.0 and 8.1 only.

NR Godale Jul 21, 2015 3:48 AM (in response to Luciano MullerNicoletti)

Like (0)Actions

Luciano Muller Nicoletti Jul 21, 2015 4:01 AM (in response toNR Godale)

Page 15: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 15/16

Like (0)Actions

Refer : https://kb.bmc.com/infocenter/index?page=content&id=KA395757&actp=search&viewlocale=en_US&searchid=1437467008561

Kiran Hullule Jul 21, 2015 3:51 AM (in response to NR Godale)

Like (0)Actions

I would suggest that FTS fortification should be run on 8.1 SP2 also, I believe that v9.0 is the firstrelease whereby FTS Fortification is implemented in the OOTB code, UNLESS you have upgradedfrom an earlier version, in which case you'll still need to run FTS Fortification. To be sure however, I would raise a ticket with BMC Support for clarification, or David Still couldyou update this article after clarifying this with R&D/CE?

Ashley Hall Jul 21, 2015 5:17 AM

Like (1)Actions

In ITSM 9.0, FTS Fortification is implemented OOTB.

Manish Kotulkar Jul 25, 2015 4:31 AM (in response to Ashley Hall)

Like (0)Actions

But Manish Kotulkar, just to clarify that your statement only applies to a freshinstall of 9.0? If you were to upgrade from 8.1 to 9.0 you'd manually run fortificationor does the installer do it for you?

Ashley Hall Jul 27, 2015 3:24 AM (in response to Manish Kotulkar)

Like (0)Actions

Hi,Fresh is anyways taken care.Upgrade case say from 8.1 ­ 90:ITSM 9.0 getting upgraded usingAR_IMPORT_OPT_OVERWRITE_FULL_TEXT_OPTION, so new 9.0ITSM .def will get imported with this option and it will be overwritten to

Manish Kotulkar Jul 28, 2015 6:37 AM (in response to Ashley Hall)

Page 16: [BMC Remedy AR System] the Pulse_ FTS Fortific..

8/7/2015 [BMC Remedy AR System] The Pulse: FTS Fortific... | BMC Communities

data:text/html;charset=utf­8,%3Cdiv%20class%3D%22jive­blog­info%22%20style%3D%22margin%3A%200px%3B%20padding%3A%203px%200px%2010… 16/16

existing base object. So Fortification will get applied in upgrade case too.As ITSM 9.0 Def are FTS Fortification enabled.

Like (1)Actions

Manish Kotulkar, Can I however confirm that whilst the base object is upgraded andFTS attributes are fortified, IF the version being upgraded has anoverlay (for example on the 'HPD:Help Desk' form) which altersFTS properties that essentially the system isn't really fortifieduntil the customised Overlay is removed?

Ashley Hall Jul 29, 2015 4:24 AM (in response to Manish Kotulkar)

Like (1)Actions

If overlay is crated for say HPD:Help Desk but OverlayType property For any field is still "No Overlay" thenwhatever gets imported as a part of Base objects byITSM 9.0 then fields in the Overlay will automatically getsthe newer fortified attributes. e.g.HPD:Help Desk, Worklog field in base has MFS Only andin overlay we did not change. And it's overlay Type is "noOverlay". 90 ITSM say modified it to None (fortified this field) inbase then it will automatically carried forward to overlayFor Worklog field: Index for FTS = "None". And if the Overlay Type is Overwrite then user has tochange explicitly the FTS properties for that particularfield. Since we marked it has Overwrite so it's intentionaland wanted to change the properties against baseversion.

Manish Kotulkar Jul 31, 2015 5:35 AM (in response to AshleyHall)

Like (0)Actions